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NETWORK HAVING SECUR E FAST PACKET 
SWITCHING AND GUARANTEED QUALITY OF SERVICE 

Field of the Invention 

This invention relates to commiinication networks, 
and more particularly to an apparatus and method for providing 
a high transfer rate, guaranteed quality of service> and 
secure internetworking of packet-based LAN and WAN segments 
by establishing temporary connections which are protocol- 
independent and transparent to the end systems. In addition, 
this invention is directed to allocating bandwidth by 
multiple levels of arbitration among competing devices 
requesting access to a bandwidth-limited shared resource, and 
to a search method for making a best path determination 
through the network based on a number of constraints. 

Background of the Invention 

Data networks today rely heavily on shared medium, 
packet-based LAN technologies for both access and backbone 
connections. The use of packet switching systems, such as 
bridges and routers, to connect these LANs into global 
internets is now widespread. An internet router must be 
capable of processing packets based on many different 
protocols, including IP, IPX, DECNET, AppleTALK, OSI, SNA and 
others. The complexities of building networks capable of 
switching packets around the world using these different 
protocols is challenging to both vendors and users. 

Standards-based LAN systems work reasonably well at 
transfer rates up to about 100Mbps. At transfer rates above 
100Mbps, providing the processing power required by a packer 
switch interconnecting a group of networks becomes 
economically unrealistic for the performance levels desired. 
This inability to economically "scale up" performance is 
beginning to cause restrictions in some user's planned 
network expansions. Also, today's data networks do not 
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provide network managers with enough control over bandwidth 
allocation and user access. 

Tomorrow's networks are expected to support 
"multimedia" applications with their much greater bandwidth 
and real-time delivery requirements. The next generation 
networks should also have the ability to dynamically 
reconfigure the network so that it can guarantee a 
predetermined amovint of bandwidth for the requested quality 
of service (QOS). This includes providing access, 
performance, fault tolerance and security between any 
specified set of end systems as directed by the network's 
manager. The concept is to provide network managers with 
complete "command and control" over the entire network's 
infrastructure — not just tell them when a failure has 
occurred. 

A new set of technologies known as asynchronous 
transfer mode (ATM) may provide the best, long-term solution 
for implementing the requirements of both private and public 
internets. ATM promises to provide a more economical and 
scalable set of technologies for implementing the 
ultra-high-performance information networks that will be 
required to provide the quality of service users will 
demand. Thus, over the next 20 years, the network 
infrastructure may change from packet-based standards to one 
based on ATM cell switching. While changes in the 
accompanying network will be dramatic, it would be desirable 
for users making the transition to be able to. retain their 
most recent equipment investment. 

Another expected change in tomorrow's networks is a 
change in data flow. Data flow in today's network typically 
follows the client-server computing model. This is where 
many clients are all transferring data into and out of one or 
more network servers. Clients do not normally talk to each 
other; they share data by using the server. While this type 
of data exchange will continue, much more of the information 
flow in tomorrow's networks will be peer-to-peer. Since the 
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ultimate goal is a truly distributed computing environment 
where all systems act as both the client and server, more of 
the data flow will follow a peer-to-peer model. The network 
will be required to provide more direct access to all peers 
wishing to use high-performance backbone internets 
connecting, for example, the desktop computers. 

The bulk of information transported in the future 
will be of digital origin. This digital information will 
require a great deal more bandwidth than today's separate 
voice, fax, and SNA networks which operate with acceptable 
performance using voice grade telephone lines. Voice will 
shrink as a percentage of total traffic, while other forms of 
information including image and video will greatly increase. 
Even when compressing is available, the bandwidth 
requirements for both inside and outside building networks 
will need to be greatly expanded. 

Text files and images can be sent over existing 
packet -based networks because the delivery of this 
information is not time critical. The new traffic (voice and 
video) is delivery time sensitive — variable or excessive 
latency will degrade the quality of service and can render 
this information worthless. 

Thus, the new infrastructure requirements are 
expected to include: 

• increased workstation processing power at the 
desktop, which is driving the need for increased 
network performance and capacity; 

• increased numbers of network users, which is driving 
the need for increased network security; 

• network access and bandwidth allocation must be 
managed; 

• integrated voice, video and data applications are 
increasing the need to be able to guarantee improved 
network quality of service (QOS); 
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• management must be able to provide a variable 
quality of service to each user based on their 
particular, needs (a user's needs may change at any 
time) ; 

• the ability to guarantee each user's QOS can only be 
achieved by tightly integrating the network and its 
management systems . 

It is an object of the present invention to provide 
an apparatus and method which satisfies one or more of the 
above-mentioned requirements. 

Summary of the Invention 

In one important aspect, the present invention is a 
new technology referred to as secure fast packet switching 
(SFPS). SFPS will provide the same or better reliability and 
security as routers and with much greater packet switching 
performance, without an increase in cost. This is because 
the complexities and costs of providing multi-protocol 
routers increase greatly as performance needs go up. Also, 
SFPS provides the following capabilities, which routers 
cannot provide: 

• ability to create many separate, logical work group 
LANs on the same physical network 

• ability to create many separate virtual connections 
or circuits with a specified quality of service (QOS) 

• ability to guarantee a requested QOS — time 
sensitive delivery 

• ability to account for network use (why is the phone 
bill so high?) 

Although ATM cell switching may similarly provide 
many of these new capabilities, adoption of cell switching 
would require that all existing networks be re-engineered. 
SFPS provides a transition between the packet based 
technologies of today and the cell based technologies of 
tomorrow. SFPS will enable a mixed packet and cell based 
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network infrastructure to operate as one seamless switching 
fabric using the same service and configuration management 
system to deliver the QOS that users demand. 

SFPS provides for high performance packet switching 
based on source and destination MAC IDs — the unique medium 
access control (MAC) address assigned to each end system by 
the IEEE. End-to-end connections are determined by a network 
management application that provides security and best path 
routing determinations based on a number of constraints. By 
switching connectionless datagram packets based only on MAC 
layer information, the network infrastructure can remain 
protocol insensitive. This allows the network to provide an 
equal QOS to users sending packets based on NetBIOS, LAT, IP, 
IPX, SNA, or any other protocol. As protocols evolve the 
network and its management infrastructure will not have to be 
reworked to support the new protocols. 

More, specifically, the system uses source and 
destination MAC addresses which alone, or in combination with 
the input port on the switch, form a unique "connection 
identifier" for any coram\inication exchange between end 
systems to be connected through an SFPS device. A specific 
example is as follows: 
input port = 2 

source MAC address = GO : 00 : ID: 01 : 02 : 03 
destination MAC address = 00: 00: ID: 11: 22: 33; 
together, these form a "tuple" bound to a specific 
uni-directional flow from source address to destination 
address. All packets that have this tuple are automatically 
switched according to the operation of the SFPS. 

Network infrastructures are built up around a core 
switching fabric. The switching fabric provides the physical 
paths or routes that allow users to send information to each 
other. Access to the switching fabric is gained through an 
access port. Access ports provide several fimctions — most 
importantly, they provide security and accounting services. 
Access ports also provide the network operator with the 
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ability to monitor and control the access into and use of the 
switching fabric. End point systems such as personal 
computers (PCs), workstations, and servers connect to the 
access port using one of many access technologies such as 
Ethernet, Token Ring, FDDI, or ATM. 

In a SFPS network, the access port acts as a 
management agent that performs five functions for the end 
point system. First, it provides directory services. Second 
it provides network access security services. Third, it 
provides routing services. Fourth, it provides the ability 
to reserve bandwidth along a path in the switching fabric. 
Finally, it provides accoiinting services. These five 
services: directory, security, routing, bandwidth management 
and accounting are required to provide a reliable network 
infrastructure . 

In traditional bridge and router devices, each 
packet is treated as an independent \init of data called a 
datagram which is individually processed by application of 
access and security constraints, as well as path 
determination. In SFPS, this processing is done only on 
probe packets (common on LAN broadcast mediums) which are 
decoded, and through the use of a directory of end systems 
containing policy, call attributes, location, paths, quality 
of service, etc., the connection is either rejected or 
accepted, in which case the path is determined and switches 
along the path are "programmed'* to allow subsequent packets 
on this "connection" to be switched. In either case, 
subsequent datagrams are either switched or discarded without 
having to re-apply all of the security and access control and 
path determination logic. 

Another important aspect of the present invention is 
a method of determining a path between two nodes (end 
systems) on the network which has the following properties: 
the path is optimal for one metric and passes a set of 
threshold tests for a number of other metrics; and, it must 
do so within a given time constraint. The method is a 



WO»5/20850 



PCTAJS95/01026 



- 7 - 

breadth first recursive search in parallel which is initiated 
at the source node and proceeds outwardly to discover 
neighboring nodes and calculate traversal paths until 
reaching the destination node. The method includes a series 
of "pruning steps" to insure that the number of potential 
paths does not grow towards infinity and to limit the memory 
requirements and processing time of the search. Because of 
these real-world constraints (time, memory, processing), the. 
path result may not be the mathematical (theoretical) best 
path, in every case, but the search will pursue those paths 
having a high probability of being the best path considering 
the constraints and in that sense the search will make a best 
path determination. Generally, the metrics include cost, 
bandwidth, policy, loss, etc. While a specific embodiment of 
the method is useful in determining an optimal path through 
the network, the method has much broader applications. 

In another aspect, the present invention provides a 
method and apparatus allowing multiple levels of arbitration 
among competing devices requesting access to a 
bandwidth-limited, shared resource. 

The first level of arbitration is programmable. The 
available bandwidth of the bandwidth- limited, shared resource 
can be equally allocated between all competing devices or 
some of the competing devices can be allocated more bandwidth 
than others. This feature of the present invention is useful 
when the maximum aggregate bandwidth requirements of the 
requesting devices are greater than the bandwidth of the 
shared, bandwidth-limited resource. Because it is 
programmable, the arbitration system of the present invention 
can be used to allocate the available bandwidth to prioritize 
those competing devices that may more urgently need the 
bandwidth-limited, shared resource and other competing 
devices will only be allocated a fraction of the bandwidth 
that they actually need. However, these other competing 
devices will be allowed to use free time segments, thus 



wo 95/20850 



PCTAJS95/01026 



- 8 - 

effectively being able to use more bandwidth than they are 
programmed for in the first level of arbitration. 

For those competing devices requiring isochronous 
service (including, but not limited to voice data and video 
data), only the first level of programmable arbitration is 
used. These devices are programmed not to participate in any 
other levels of arbitration except the first level. This 
allows these competing devices to use the time segments that 
are programmed for them, but not any of the time segments 
that may become available when a device does not require its 
programmed time segment. For example, an audio communications 
link requiring a very deterministic service policy would be 
programmed to use only the first level of arbitration and not 
any free time segments. The arbiter of the present invention 
is programmed with an adequate number of segments to support 
the bandwidth requirements of the audio communications link. 
These time segments are made available to the audio 
communications link in a periodic way that matches the 
bandwidth requirements of the device. 

Additional levels of arbitration are provided to 
allocate unused time segments that may be available after the 
first level of arbitration to competing devices if the 
competing devices are programmed to participate in the 
additional levels of arbitration. The second and third 
levels of arbitrations allow unused time segments that may be 
available after the first level of arbitration to be assigned 
to other competing devices. The second level of arbitration 
provides a Round-Robin type of arbitration scheme that is 
used to allocate a free time segment to the competing device 
having the allocation token. If the competing device having 
the allocation token is not requesting use of the 
bandwidth-limited, shared resource / then a third level of 
arbitration is provided. In the third level of arbitration, 
each of the competing devices participating in the third 
level is assigned an identification number and placed in a 
list and the remaining free time segment is allocated to the 
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competing device having a predetermined rank in the list. 
For example, the predetermined rank may be based on the 
sequential order of the identification numbers. The 
unallocated time segment might be allocated to the requesting 
competing device having a particular identification number, 
such as the lowest or highest identification number. 

A key feature of the present invention is that 
arbitration is performed using a hierarchy of programmable 
arbitration schemes. The first level of arbitration is, for 
example, a programmable time division multiplexing arbiter. 
The second level of arbitration, which acts only to allocate 
any unused time segments after the first level of arbitration 
is, for example, a Round-Robin type arbiter. The third level 
of arbitration, which acts to allocate any time segment that 
remains unallocated after the second level of arbitration is 
a default level of arbitration that selects one of the 
requesting competing devices according to a predetermined 
scheme. 

Another advantage of the arbitration system of the 
present invention is that arbitration is performed in 
parallel with data transfer cycles. That is, the competing 
device that is to be given exclusive use of the 
bandwidth-limited, shared resource is decided in the time 
segment prior to the time segment in which a data transfer is 
to occur. The arbitration decision is made at the same time 
that a data transfer is occurring in a time segment. 
This pipelining of decision making effectively makes the 
arbitration cycles look transparent to the competing devices 
and does not consume any portion of the available data 

transfer time. 

The arbitration system of the present invention can 
support devices having different bandwidth requirements 
(i.e., different data transfer rates) in the same system 
because the system is programmable. In one embodiment of the 
invention, the granularity (that is, the amount of bandwidth 
represented by a time segment) of the time segments is 
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programmed using an allocation memory. As the number of time 
segments in the allocation memory is increased/ the 
granularity of bandwidth allocation becomes finer. 
Therefore, the arbitration system can meet the bandwidth 
requirements for competing devices that have differing 
bandwidth requirements. For example, a competing device 
having a low bandwidth can be assigned only a single time 
segment, since the low bandwidth device requires 
less frequent servicing. On the other hand, a competing 
device having a higher bandwidth could be assigned multiple 
contiguous time segments, thus allowing that device to 
complete a data transfer. 

Another feature of the present invention, since it 
is a programmable arbitration system, is that the type of 
arbitration for each device may be programmed on a device by 
device basis. For example, a device may be programmed to 
participate only in the first level of arbitration and not in 
the second or third levels. In the same way, a device could 
be programmed to participate only in the second and/or third 
levels of arbitration. This makes the system more flexible 
depending upon the particular application and helps to 
guarantee quality of service for each competing device. 

Many aspects of the previously defined inventions 
may be constructed as: software objects which exist in 
embedded devices as firmware; software objects which are part 
of an application on a commercial computer system; or 
Application Specific Integrated Circuit (ASIC) or 
functionally equivalent hardware components. 

These and other functions and benefits of the 
present invention will be more fully described in the 
following detailed description. 

Brief Description of the Drawings 

Fig. 1 is a schematic illustration of a network 
topology built with SFPS switches; 
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Fig. 2 is a schematic illustration of the internal 
components of an SFPS switch in a hardware embodiment; 

Fig. 3 is a flowchart of the operation of the SFPS 

switch of Fig. 2; 

Fig. 4 is a perspective view of a networking chassis 

with removable modules; 

Fig. 5 is a schematic diagram of a networking module 

with a SFPS switch; 

Fig. 6 is a schematic illustration of the networking 
chassis and the services it provides; 

Fig. 7A is a schematic illustration of an SFPS 

switch; 

Fig. 7B is a logical view of an SFPS switch; 
Fig, 7C is a flowchart showing processing of a data 
packet by an SFPS switch; 

Fig. 8 is a schematic illustration of a distributed 

SFPS switch; 

Fig. 9 is a schematic illustration of a chassis and 
distributed switch and illustrates the formation of a 
distributed directory of port objects for the distributed 
switch; 

Fig. 10 is a schematic illustration of the 
distributed switch on the physical and logical layers; 

Fig. 11 is a flowchart illustrating a best path 

determination; 

Fig. 12 is a schematic illustration of certain 
linked data structures used in the method of Fig. 11; 

Fig.' 13 is a sample network topology illustrating a 
traversal from a source node to destination node; 

Fig. 14 illustrates a networking chassis with an 
exemplary application of the bandwidth arbiter of the present 
invention; 

Fig. 15 is a schematic diagram of one embodiment of 
the arbiter used in the networking chassis of Fig. 14; 

Fig. 16 illustrates a first programmed state machine 
that may be executed by the circuit of Fig. 14; 



wo 95/20850 



PCT/US95/01026 



-12- 

Fig. 17 illustrates a second programmed state 
machine that may be executed by the circuit of Fig. 14; 

Fig. 18 is a flow chart illustrating how arbitration 
and allocation of time segments take place simultaneously to 
improve system efficiency in the present invention; 

Fig. 19 is a flow chart illustrating the arbitration 
method of the present invention; 

Fig. 20 is an illustration of the TDM RAM 
programming illustrating the arbitration method applied to an 
SFPS switch; 

Fig. 21 is an illustration of an SFPS software 

embodiment ; and 

Fig. 22 is an illustration of a port object for the 

switch of Fig. 21. 

Detailed Description 

The detailed description is separated into the 
following subsections for ease of reference: 

1. Establishing "Virtual LANs" and "Virtual Connections" 

1.1 Example 1 - Mil transmits a packet destined for M99 

1.2 Example 2 - Mil transmits a packet destined for M66 

2. SFPS Management Services 

2.1 Route Services Management 

2.2 Access Security Management 

2.3 Directory Services Management 

2.4 Accounting Management 

2.5 Bandwidth Management 

3. SFPS Hardware Implementation 

4. Canonical Frame Representation 

5. Networking Chassis With SFPS Modules 
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6. SFPS Functions 

7. SFPS Host Agent 

8. SPFS Distributed Switch 

8.1 Example of IP Packet Flow Through Distributed Switch 

8.2 Distributed Switch MIB 

9. Best Path Determination 

9.1 Example of Best Path Determination 

9.2 Data Structures 

9 .3 Flow Chart 

10. Allocation of Bandwidth 

10.1 Discussion of the Related Art 

10.2 New Apparatus and Method for Allocating Bandwidth 

10.3 Example of Bandwidth Allocation For SFPS Module 

11. SFPS Software Object Model 

11.1 SFPS Objects 

11.2 SFPS Application Threads 

11.3 MIB and its Managed Object Definition 

12. Related Applications 

1. Establishing "Virtual LANs" and 
"Virtual Connections" : 

Fig. 1 shows a representative network topology built 
with six secure fast packet switches (SFPS) labeled SI to S6 
connected by links L. Each SFPS switch has for example, four 
ports. Some ports are labeled A for Access and some are 
labeled N for Network. Access ports provide network access 
security and packet routing services. Network ports do not 
perform security services since this function has already 
been performed at the original entry access port. The end 
systems are connected to the switches by links L and are 
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labeled "M one of the end systems MlO, comprises a 

network management server (NMS) . This NMS will also contain 
the SFPS directory and path server. 

Each SFPS includes a function known as a Connection 
Database Look-Up Engine (CDLUE). The CDLXJE*s job is to check 
the source and destination MAC IDs of a packet received by 
the SFPS against its internal database, called the connection 
table. The CDLUE will forward (route) packets out one or 
more ports based on the results of the connection table 
look-up. This function is similar to a bridge except 
that SFPS uses both the source and the destination MAC IDs to 
make the forwarding decision. Bridges only use the MAC 
destination address. Also, if a bridge isn't sure where a 
destination is, it will forward the packet put all ports 
except the one it came in on. This "flooding" results in 
loss of control over network access, bandwidth, information 
security, network performance and reliability. Because SFPS 
uses both the source and destination addresses it does not 
have the failings of current bridges and routers. 

The network topology view of Fig. 1 will be used to 
illustrate how "virtual LANs" and "virtual connections" can 
be built to enable protocol insensitive routing and increased 
network security to be achieved. In this case, there are two 
logical work group LANs: WGl = (Mil, M22, M99), and WG2 = 
(M33, M55, M77) . Two connections will be attempted: (Mil, 
M99) and (Mil, M66). 

1,1 Example 1 - Mil transmits a packet 
destined for M99 . 

1. Access switch SI receives this packet on inboxind 
port Al . 

2. SI looks up in its connection table to determine if 
a valid connection (Mil to M99) exists. 

3. No connection is yet defined so SI initiates a 
message exchange to the SFPS Server (Network 
Management Station) MlO. This message exchange is 
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an independent exchange between the switch SI and the server 
MIO. 

a) The switch sends a message asking if Mil can (is 
allowed) to talk to M99. 
This is where security, policy and 
administrative constraints are applied. 

b> If the two stations are allowed to have a 

connection, then the server MIO will determine 
the path of switches to be used to provide a 
logical connection between Mil and M99. 

c) Since Mil can reach M99 by two different 
paths, one "best" path is selected. "Best" is 
constrained by, for example, cost, bandwidth, 
policy, loss, and other metrics. 

d) Let's assume the best path is chosen as 
traversing Si to S3 to S5. 

e) The server MIO will then "program" each of these 
switches to support this connection path. 

*Important point: Since SFPS has to be 
transparent in the M11-M99 interaction, it 
cannot modify the packets being exchanged. 
Typically/ in traditional switches, the switch 
sets a connection-identifier that gets put in 
each packet, and is remapped at each switch, to 
allow the packet to be switched along the path. 
Since SFPS cannot touch any packet content, it 
has to have something in the existing packet 
that it can use in each switch to treat as a 
unique connection-identifier while preserving 
the Mil to M99 packet exchange. What is unique 
about SFPS is that it treats: 

- source MAC address 

- destination MAC address 
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as a unique "connection-identifier." Note, that 
this is an implicit connect ion- identifier in 
each packet based on the arriving inbound port, 
but is an explicit connection-identifier in each 
switch's connection table. 



f) Each of the switch's connection tables will look 
like this: 



Source Port 
SI: Al 
S3: Nl 
S5: N2 



Source MAC 
Mil 
Mil 
Mil 



Pest. MAC 
M99 
M99 
M99 



Outport 
N2 
N3 
A2 



g) So, once all these switches are programmed 

(through, for example, SNMP Network Management 
Protocol), a packet from Mil destined for M99 
would look like this: 



M99 



Mil 



Packet Data 



and would be "switched" along the path as 
follows : 



Mil ^ A1-S1-N2 N1-S3-N3 N2-S5-A2 M99 

h) Note that once the switches have these 

connections defined, the packets traverse Mil to 
M99 without any additional call-setup or network 
management interaction. This provides the fast 
packet switching between the end systems. Note, 
the Mil to M99 packet exchange occurs as if they 
were directly connected on the same LAN segment. 
Thus, the "virtual LAN" is provided, as well as 
transparent switching. 
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i) At each switch, the switch looks up in the 

packet the source and destination MAC addresses 
and combines them with the inbound (source) port 
to form the connection identifier. If this 
connection is in its table, the packet will be 
forwarded (switched) out the designated output 
port. All subsequent Mil to M99 packets will 
take the same path through the switches. Note 
if a valid source-destination MAC pair arrives 
on a port other than the defined inport, it will 
be considered a security violation. 

j) These "virtual connections" exist until they are 
explicitly removed by the network management 
system. This could be due to timeout (idle 
connection) or resource management. No explicit 
disconnect is done by Mil or M99. 

1.2 Example 2 - Mil transmits a packet 
destined for M66. 

1. If Mil also transmits data destined for M66, the 
same set of processing would be done; 

a) SI receives the packet. 

b) SI looks up in its connection table and with no 
match will send a message to server MIO. 

c) Server MIO will reject the packet as 
\inauthorized (not within one of the two approved 
logical work group or "virtual" LANS) and the 
packet will be dropped without a connection 
being made. An alarm may be set to indicate 
that an unauthorized transmission has been 
attempted. 

2 . SFPS Management Services 

In this particular embodiment, the SFPS switches 
require five management service functions to be performed at 
a higher layer in the network management framework. The five 
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functions are: Route Service, Access Security, Directory 
Service, Accounting, and Bandwidth Management. A general 
review of each management function is provided below. The 
functions are usually performed in software and may reside on 
none, some, or all SFPS in a network. Since some of the 
management functions are required by multiple-user 
applications, they may be shared and would be already 
available. 

2.1 Route Services Management : These services are 
required so the SPFS can determine the best path to route a 
connection. When there are many possible "paths" to a 
destination, the route management will determine which one 
should be used and pass this information to the.SFPSs so that 
their connection databases can be configured correctly. A 
preferred method of making a best path determination is 
described in a later section. 

2.2 Access Security Management : These services are 
optional and can be used to limit user access to only a 
specified group of SFPS access ports. An access group may 
contain from 2 to any number of users. Users can only send 
or receive packets from members of their access group. 
Access to any other access ports would be prevented by 
filtering out those packets. Security also includes 
administrative policies. 

2.3 Directory Services Management : These services 
provide the Route Services Management with a user to access 
port and switch database so that packets destined for users 
not directly connected to the local access switch can be 
located and then have a path to that switch selected. This 
service reduces the amoxint of time it takes for a connection 
to be established. An ISO X.500 Directory Services may be 
used which is compatible with NIS, Novell 4.0 and others. 

2.4 Accounting Management : These services provide an 
accounting of each user's use of the network and provide the 
network manager with usage and cost reporting so that proper 
use of corporate network resources can be verified and traced. 
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2.5 Bandwidth Management : As network usage grows, 
congestion of the network connection will likely occur. The 
bandwidth management service insures that bandwidth is 
allocated to highest priority users first and that the 
network is always available for those users should congestion 
occur. Lower priority users would have their packets dropped 
when congestion occurred. A specific multi- 
level programmable arbiter for making bandwidth allocations 
is described in a later section. 

3. SFPS Hardware Implementation 

In a specific hardware embodiment, the SFPS is a 
multiported data communications device shown in Fig. 2 
(physical layer — external ports not shown) . 
Fig. 3 is a flow chart showing the frame processing of the 
SFPS switch. 

Data enters the SFPS 10 through one of its ports in 
a format known as the Canonical Frame Format, which is 
described in a later section. The canonical frame format has 
the following structure: 



Table l: Canonical Frame Format 

Destination Source LU: Information C^i. 
Header Address Address Field __rveW ^!5S_ 

(64 bits) <64 bits) (64 bits) (64 bits) (0 or more bytes) (16 bits) 



As shown in Fig. 2, the SFPS lO has a common 64 bit 
wide packet data bus 11 that is shared by all ports, as well 
as by a memory array referred to as "packet ram" 12. When 
data arrives at a given port (step 20 in Fig. 3), the port 
signals to a multilevel programmable arbiter (MPA) 13 that i 
is ready to transfer data into the SFPS system (step 21). 
The MPA is used to allow each port a "timeslice" on the bus 
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11 SO that data may be transferred into the SFPS and stored 
into packet ram. 

The SFPS system requires ports that deliver data in 
to deliver an entire packet before beginning the next 
packet. The packet data bus control system in conjunction 
with the MPA establishes a 10 elk (clock) cycle "timeslice" 
for data transfers (32 bytes of information). Transfers can 
be in either direction. Inbound transfers are referenced as 
a port delivering data into the packet ram, and outbound 
transfers are those in which data is sourced from the packet 
ram and sent out through a port towards the datalink. A 
transfer of the data packet in or out of the SFPS may take 
multiple timeslices. 

When a port receives an acknowledgment from the MPA, 
it signals "start of frame" (SOF) on the control bus 19. 
This informs the lookup process that the beginning of a data 
packet will be traversing the bus 11 and that it should copy 
the DA and SA fields so that it may proceed with a lookup 
operation (step 23). Now, in parallel, the lookup process 
will be forming the results word (steps 24, 26) while the 
port continues to transfer the entire packet into the packet 
ram 12 (step 22), controlled by the DMA process. Once the 
end of the data packet is delivered, the port signals "end of 
frame'* EOF which tells the DMA 16 that it is done. This 
causes the DMA, who has been maintaining a byte count for the 
packet, to transfer this information to the forwarding 
process along with a pointer to the location of the data 
packet in packet ram. Additionally, the input port nxmber is 
sent to the forwarding process (from the DMA), The 
forwarding process then proceeds. 

The common bus 11 also indicates which port is 
transferring the data into the packet ram 12; this 
information is used by the lookup circuitry 14 so that it may 
associate the DA-SA data with a certain inbo\ind port (step 
24), The lookup circuitry 14 is where the connection 
database table is maintained. This table is what is 
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established by the SFPS connection setup application. It 
indicates for a particular DA-SA pair on which port(s) the 
data shall be sent outbound (step 25). The table also 
provides a field which identifies the allowable in-port for 
this DA-SA connection. The lookup circuitry will match the 
actual inbound port with the allowable in-port to ensure that 
the data has entered this switch from a pre-authorized 
location (step 24). 

The lookup process passes an information structure 
to the forwarding logic, which the forwarding logic acts on. 
The information structure, known as the "results" word, 
contains the following: 

1) Inj)ort — the allowable injort, used by the lookup 
process. 

2) Out_port/Index — this will be a single port number, 
or an index into a ram which contains a port_mask to 
be used when the packet is intended to be delivered 
out more than one port. This ram is located within 
the forwarding logic . 

3) The actual in_j)ort — to be used for statistics 
collection, since the lookup process has performed 
the in_port match against the allowable in_port 
field. 

4) Injport violation — a single bit indicating that 
the injport check passed/ 

failed; this is used by the forwarding logic. 

5) Unknown connection — a bit indicating that the 
connection entry was not foxind in the connection 
database. This packet will be delivered to the host 
for directory assistance. 

The forwarding logic acts on this data to produce a 
"outmask." This is a mask that is as wide as the number of 
ports in the system. This mask, for each bit set, indicates 
the desire to forward this data packet out the specified 
ports . 
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The forwarding logic 14 waits on two pieces of 
information to complete its task, which is to write the 
outmask to the transmit queue logic 15. One piece of 
information is the results word for a given port (from the 
lookup logic — step 24); the second is a data structure that 
is written by the DMA control logic 16 (a pointer to where 
data resides in packet RAM — step 22). 

The forwarding process upon receiving this structure 
from the DMA checks with the lookup process for the 
completion of the table search and result word formation for 
that port. If lookup search and frame reception are both 
complete, the forwarding process 14 then translates the out 
port information into a mask which it writes to the transmit 
queues 15. 

There exists at least one transmit queue per port 
(see Q^, ..w in transit queue 15 of Fig. 2). Each 
queue is connected to a network interface block 18 (NIB^, 
NIB^, respectively). If an entry exists on a queue, 
the port that the queue is associated with is signalled so 
that the port may request that information. A queue entry is 
merely a pointer to a data packet which resides in packet 
ram. This pointer is what the forwarding process writes 
onto the queue in what is called a forwarding operation. The 
port then signals to the MPA 13 that it wishes to perform an 
outbound data transfer. Once granted, the DMA controller 16 
will source the appropriate data from the packet ram 12 onto 
the packet data bus 11 (step 27). There is a link 17 between 
the DMA control process and the queue process. When 
transmitting, the DMA reads the pointer entry off the 
appropriate queue based on the port number that is requesting 
the transmit operation. All along, the DMA process has been 
maintaining in its internal memory the length of each packet 
in the packet ram. When the pointer is read from the queue 
and the transmit operation begins, the DMA process decrements 
a working count value which is first loaded with the full 
packet length. As transmission proceeds and this coiinter 
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reaches zero, the DMA process signals "end of frame" (EOF) 
and the port stops requesting data transfers (unless there is 
another entry on its transmit queues). 

4. Canonical Frame Representation 

Different data links (LAN segments) specify and use 
dissimilar formats to encapsulate and represent data. In 
order to provide an extensible system, it is advantageous for 
each data link sub-system to translate incoming frames, and 
represent them canonically. Intermediate systems, such as 
the networking chassis backplane, then need only understand 
this canonical representation in order to operate on the 
received frames. 

To this end, it is expected that data link 
sub-systems will translate incoming frames from native to the 
canonical format, and perform the converse operation for 
frames to be transmitted. In the later-described embodiment 
entitled "Networking Chassis With SFPS Modules", a networking 
chassis having a common bus receives removable modules; if 
all external interfaces on a particular module are similar, 
the module may choose to translate (from native to canonical) 
before transmission out onto the common chassis bus. The 
point of translation within any module is a realization 
issue. 

The encapsulation method utilized herein is 802.2 
LLC, more specifically 802.2 Subnetwork Access Protocol 
(SNAP) SAP. It provides mechanisms to encapsulate DIXE 
frames, with no loss of information 

content. Using this mechanism, and accounting for various 
datalink address formats, the canonical representation is as 
follows: 
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Table 1: Canonical Frame Format 



Header 



Destination 
Address . 



Source 
Address 



LLC 
Field 



Information 
Field 



Check 
Sum 



(64 bits) 



<64 bits) 



<64 bits) <64 bits) (0 or more bytes) (16 bits) 



The "header 



is a packet description provided for 



use by the SFPS switch. The "destination address" is the 
physical MAC address of the destination end system. The 
"source address" is the physical MAC address of the source 
end system. The LLC field is the IEEE 802.2 LLC header. The 
"information field" is the client layer data. The "check 
sum** is a 16 bit field for confirming packet integrity. 

5. Networking Chassis with SFPS Modules 

Fig. .4 is an illustration of a networking chassis 
adapted to incorporate the SFPS technology. As shown, the 
chassis 30 is a mechanical enclosure 31 which is used to 
house a plurality of networking modules 32, which may include 
repeater modules, bridge modules, router modules, terminal 
servers, file servers, etc. The chassis provides slots into 
which the networking modules are inserted. In addition to 
being a mechanical enclosure, the chassis provides a 
backplane 33 through which the modules inserted into the 
chassis are provided power from the chassis' power supply 34 
and networking connectivity between modules. The backplane 
includes a system management bus (SMB) for network management 
functions/ and. a high-speed data bus known as the INB". 



LAN segments, including Ethernet, Token Ring and FDDI 
segments, as well as to wide area networks (WANs). In • 



The chassis or hub enables the connection of diverse 
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addition, the chassis provides connection to an asynchronous 
transfer mode (ATM) switch across its backplane. 

Each module 32 is microprocessor based, e.g., i960 
sold by Intel Corporation. Fig. 5 illustrates a module 
embodying an SPFS switch 40 which is linked to the module's 
host processor 41 by a pair of port interface links 42 for 
transfer of data, and a pair of status/control links 43 for 
transfer of status and control signals. The control and 
status interface is viewed by the host CPU as a set of 
registers that control the configuration and switching 
policies of the SFPS, as well as allowing the host CPU access 
to diagnostic information and switching statistics. 

The SPFS 40 provides packet switching services 
between network data interfaces 44, 47, and 50 according to 
the criteria set by the host CPU 41. 

The network data interface consists of a data path and 
several handshaking signals. By way of example. Fig. 5 shows 
an Ethernet interface 44 with handshake and data links 45-46, 
FDDI interface 47 with handshake and data links 48-49, and a 
backplane interface 50 (to the networking chassis backplane 
33) with handshake and data links 51-52, The network data 
interfaces 44, 47 can be configured to handle, for example, 
up to 16 separate network ports, or one high speed port. The 
amoxint of bandwidth granted each network data interface is 
determined by the implementation of the SPFS; a specific 
example of programming the MPA arbiter on the SFPS is 
described in a later section. The SPFS handshaking signals 
allow the network interface block (NIB) to request use of the 
SPFS, as well as synchronize the transfer of data. The NIB 
provides translation of the original frame format to the 
canonical format as well as protecting the data with checksum 
coverage. 

■ Fig. 6 is a schematic illustration of the various 
functions provided by the networking chassis or h\ib 30. The 
chassis is schematically shown in segments consisting of:. 
CPU; ATM; Ethernet; Token Ring; FDDI; Router; Switching. The 
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chassis architecture may be implemented in C++ OOP (object 
oriented programming) software. The backplane connects 
various LAN and WAN interfaces. An integrated management 
network service is provided, based on RISC base CPUs (UNIX). 
The physical media is UTP and STP sockets, and optical 
fiber. The fxinctionality includes: connectivity; bridging; 
routing; secure fast packet switching; and ATM cell switching. 

As previously discussed, one or more of networking 
modules 32 in chassis 30 may be an ATM cell switching 
module. Such a module would need to perform packet to ATM 
cell conversion (and vice versa) for transmissions between 
the module and the chassis backplane. Within the ATM module, 
ATM cell switches function much like a router in that each 
switch receives cells from each port and then forwards them 
out the correct port (Unicast) or ports (Multicast). As the 
cell is forwarded to a switch, its header is modified with 
"next switch" routing information. This process continues at 
each cell switch until the cell is received at the end node. 
End nodes then strip away the cells and deliver the data to 
the end user or router application. Cell switches include a 
management agent (CPU) that is used to set up the logical 
connection through the switch as well as monitor the 
operation and performance of the switch and its ports or 
links. All cell switches are built aroiind the core switch 
fabric which determines its maximum performance or switching 
capacity. Usually, this is expressed in Giga-bits-per-second 
(Gbps). ATM switching capacity in the one to two Gbps range 
are now becoming available, and switching capacities in the 
20-40 Gbps range are expected within the next few years. 

The above networking chassis is designed to 
distribute the network management services across the various 
networking modules, to provide increased throughput (prevent 
bottlenecks) and fault tolerance (i.e., there is no one 
networking module which if defective, shuts down the 
system) . A system and method for implementing this 
distributed management is more fully described in a copending 
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and commonly owned application (U.S. Serial No. 08/187,856) 
filed on the same date (January 28, 1994) entitled 
"Distributed Cliassis Agent For Network Management/' filed by 
Brendan Fee et al., which is hereby incorporated by reference 
in its entirety. 

6, SFPS Functions 

The "secure" feature of the SFPS means that no 
traffic is allowed through the switch until "programmed" by 
the SCS (switch agent). All end-to-end system connections 
passing through the switch must be validated, i.e., by way of 
access list, virtual LAN, policy, etc. The switches register 
with the SCS before becoming operational. The switches 
"discover" and report end systems on each port of the switch 
to the SCS. This allows the SCS to learn thef SFPS topology 
without the SFPS switches having to run a distributed 
topology exchange protocol. 

The "fast" feature of the SFPS may be accomplished 
on hard cards, wherein packet switching is done completely in 
hardware ASICS. The network interface block (NIB) handles 
the media interface. All NIBs translate data into a common 
internal frame format, i.e., the canonical format. The 
lookup engine extracts the key fields from the frame (i.e., 
MAC source and destination addresses) as the first burst of 
data is transferred from the NIB to packet ram. The 
extracted data is then "looked up" in the connection table. 
The lookup engine provides the search function, as well as 
dynamic learning and aging of table entries. The search 
result is a code either programmed by the host CPU or learned 
by hardware that indicates where the frame should be forwarded 
based on the key fields. When the result operation is 
complete, the results are delivered to the forwarding engine. 
Alternatively, the "fast" feature can be provided by 
soft cards, wherein packet switching logic is minimized. 
There are no hierarchical lookups or header decoding beyond 
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the MAC address header. There is no variable length packet 
headers or addresses. There is no protocol type processing. 

The "packet" feature of SFPS means that the switch 
supports existing LAN packet formats, e.g., Ethernet, Token 
Ring and FDDI. No segmentation or reassembly of packets is 
required. 

The "switching" feature in SFPS means that the 
switch treats data flows as connections. The source port, 
source MAC and destination MAC become a unique tuplet which 
serves as a connection identifier. The switch always 
forwards (switches) the packet out the correct output port; 
there is no flooding out all ports. The switch uses an 
arbiter to share switch bandwidth and ports. When the 
network management service provides for distributed 
management of all modules in the networking chassis, it is 
possible to guarantee performance to designated users and 
provide varying levels of quality of service. 

7. The SFPS Host Agent 

The operation of the SFPS host agent is best 
illustrated in Figs. 7A-7C. 

Fig. 7A is a schematic illustration of a SFPS switch 
91 having a plurality of ports 92. A host port 93 connects 
the switch to its host CPU 90, which may be an i960 
microprocessor sold by Intel Corporation. The host CPU is 
connected to the system 

management bus (SMB) for receipt and transmission of 
discovery and other control messages between modules in the 
networking chassis. 

Fig. 7B-7C illustrate the internal operation of the 
switch. The SFPS switch 86 includes in ports 80, out ports 
81, connection database 82, look-up engine 83, and a 
multilevel programmable arbiter MPA 84. All of these 
components have been previously discussed with regard to the 
switch shown in Fig. 2. The switch 86 sends and receives 
messages from the host agent 85, which includes a management 
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agent 87, a discovery agent 88, and a call processing agent 
89. The interaction of the host agent, switch, SCS and end 
system will be described in the following paragraphs, 
and is illustrated in the flow chart of Fig. 7C. 

The management agent 87 provides external control of 
the configuration and operation of the SFPS switch, through 
the network management system. 

The discovery agent 88 provides a mapping of end 
systems to switching ports through a passive listening 
(snooping) capability and a registering of end system 
addresses and port locations of the host switch with an 
external directory located in the SCS. Adjacent switches are 
also discovered and mapped, but this may be done with an 
explicit switch-to-switch protocol (nonpassive) . 

The call processor 89 provides a means for 
requesting connections to be established between two end 
systems. In the case where the source-destination MAC 
addresses are not in the packet frame, i.e., usually in a 
frame that has a broadcast — all hosts — MAC address, the 
call processor will decode the packet to find source or 
destination network addresses and will use these to map back 
into the mapped addresses from the external directory located 
in the SCS. Once the end system MACs addresses are known, 
the call processor will then request the connection between 
the end systems. If the broadcast frame was a probe or 
address resolution packet (i.e., an implied connect request), 
the call processor will return a probe reply as a "proxy" 
which gives the destination end system MAC addresses. 
Siibsequently, the source end system can then send packets 
directly to the destination based on its BIAC address. 

Fig. 7C is. a flow chart illustrating what happens 
from the time a data packet is received on an input port of 
the switch, until it is sent on the correct output port. 

Referring to Fig. 7C, in step 300 the host is 
initialized. In step 301, the host programs the connection 
database to send any "xinknown" or "broadcast" connections to 
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the host port. In the next step 302, the switch waits for a 
packet to arrive- In the next step 303, a packet has 
arrived. In step 304, the switch extracts the source MAC 
address, destination MAC address, and identifies the inbound 
port on which the packet was received. In step 305, the 
look-up engine checks to see whether this source-destination 
pair is already located in the connection database. If it is 
not found in step 308, the packet is given to the host 
agent. The call processor and the host agent determine 
whether it is a broadcast destination (step 309). If the 
answer is yes, the call processor decodes the packet to find 
the network protocol source and destination addresses (steps 
310-311). A different protocol decode logic would be 
provided for each network protocol. For example, in the IP 
protocol, if an ARP request is received, the call processor 
would get the target IP address (step 312). It would then 
ask the external directory (SCS) for the MAC address of the 
target IP (step 313). In the next step 314, the SCS sends 
the MAC destination address back to the call processor. In 
step 315, the call processor asks the SCS to set up a 
connection between the source MAC and destination MAC. In 
step 316, the call processor forms an ARP reply packet by 
putting the destination MAC address inside the packet. In 
step 317, the call processor sends a reply to the source 
address. It should be noted that this reply allows the 
source end system to update its private mapping of the 
destination IP address to a nonbroadcast MAC address. All 
subsequent packets to this destination IP address will be 
properly framed with the source and destination MAC address 
for which connections will now exist. 

If the answer in step 309 is no, then the call 
processor treats it as an unknown connection (step 318), asks 
the SCS to set up the call (step 319) and discards the packet 
(step 320). 

Returning to step 305, if the source and destination 
MAC pair are found in the connection database, the data 
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packet is sent to the switch outport(s) defined in the 
database (step 306). In next step 307, the management agent 
collects statistics regarding transmissions through the 
switch and sends them to the SCS. 

8. SPFS Distributed Switch 

Similar to the manner in which management services 
may be distributed across the modules in the networking 
chassis, the SFPS functions can be "distributed" across the 
networking chassis. 

Fig, 8 is a schematic illustration of a distributed 
SFPS switch. A network 70 is shown schematically as a 
"cloud" to which there is connected by data path 71 a 
representative end point system 72. Data paths 73, 74, 75 
connect the network 70 to an SFPS switch engine 76, call 
processor 77, and SCS (switch agent) 78. This is just one of 
many ways in which the functions of the switch may be 
distributed; there are many other ways. For example, the 
call processor may be part of a stand-alone server, part of 
the SCS, part of the SFPS switch, or part of the end point 
system. Similarly, the SCS may be physically a part of some 
other network component. The following is a more detailed 
description of the operations of the distributed switch 
according to the present embodiment. 

8.1 Example of IP Packet Flow Through 
Distributed Switch 

The following example illustrates IP packet flow 
through the distributed switch. In this example, end system 
A wishes to communicate with end system B according to 
address resolution protocol ARP. ARP is a protocol for 
mapping 32-bit IP addresses to 48-bit data link layer 
addresses, as specified in RFC 826 » The SFPS switch 76 
receives the broadcast and treats it as an unknown connection. 
It forwards the broadcast out the broadcast redirect port 
(programmed by SCS 78) to the call processor 77 - see bold 
connecting arrow 94 in Fig. 8. 
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The call processor 77 processes the ARP request REQ 
packet and perforins SFPS protocol to UNI (User to Network 
Interface) translation. It looks inside the ARP for the 
destination IP address- It puts the ARP request on a holding 
queue. It makes a directory assistance call to the SCS 78, 
asking for the MAC address for the destination IP address; it 
may provide the SCS with the switch address and source MAC 
address as well- Once the destination MAC address is known, 
the call processor 77 then tries to establish a connection 
from the source to the destination. It makes a CALL-REQUEST 
(see bold arrow 95) on behalf of the end system, but does not 
set up the connection from itself. 

The SCS 78 then processes the call request from call 
processor 77. The SCS validates the call according to, i.e., 
policy, access control, virtual LANs, quality of service, 
etc. SCS 78 determines the path to connect the source and 
destination and then "programs" each switch in the path with 
a valid connection. A connection is a combination of source 
port, source MAC, and destination MAC mapped to an outbound 
port. The SCS 78 uses SNMP and switch MIBs 96 to do this; 
there is no signalling per se. SCS 78 returns CALL-ACCEPTED 
to the call processor 77- 

The call processor 77 removes the ARP request from 
the queue and fills in the destination MAC address and sends 
an ARP response to the source end system. The source end 
system now has an updated ARP cache and can send packets 
directly to the destination end system. These packets get 
switched through each switch along the path as programmed by 
the SCS. 

8.2 Distributed Switch MIB 

In the following explanation of the distributed 
switch MIB, Fig. 9 illustrates generally modules lOOA-C, each 
having a switch engine lOlA-C, input ports 102A-C, and output 
ports 103A-C, and each connected by backplane 33 of 
networking chassis 30. A "Distributed Directory for Port 
Objects" 104 is shown above which includes an object name 105 
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and object location 106 for each output port 103. 

It is important to understand how the switch MIB becomes 
distributed across the networking chassis. Essentially, the 
MIB objects are self-distributing by design in that there are 
no "flat" managed objects that would need to be replicated 
across modules. Instead, each managed object of the 
switching engine is indexed by at least a module chassis/slot 
number and in the case of ports, by a key of chassis/slot/ 
port. The key 106 is somewhat hidden by calling this a 
Portldentif ier 105 which can be specified in decimal dot 
notation. In conjunction with a MIB tree registration agent 
that distributes the name and location (think of it as a 
replicated directory of file names, but not the data) across 
each module, the MIB tree will automatically form a unique 
naming tree by redefining the name of an object to be its OID 
(Object Identifier) and its location information. This MIB 
tree replication is done totally transparent to the 
individual managed objects on each module or switch engine. 
What results is a replicated tree of the name and location of 
all switch objects and their unique instances. 

In stand-alone switching systems the MIB object 
registration and naming will be done the same as in the 
distributed, system except that MIB tree will not be 
replicated since the system itself is not a distributed 
system. However, the port objects will still use a complex 
portldentif ier to instance themselves. 

8.2.1 The Switch MIB : Despite the fact that the 
Switch MIB provides a distributed view of the MIB, it does 
not provide a single logical view of the switching system 
across all of the chassis modules. This may not be apparent 
at first, but the Switch MIB provides for a distributed 
collection of switch engines that can be accessed from a 
single MIB view (see Fig. 10 showing SCS 78 connected to 
three separate switch engines on the left as the "physical 
switching system" 110, and connected on the right to a single 



wo 95/20850 



PCT/US95/01026 



- 34 - 

"logical switching system" 111). The implications are that 
the SCS control agent must be able to manage and program each 
of the individual switch engines. For example, to obtain a 
connection path that had its ingress port on one module and 
its egress port on a different module, the SCS controller 
would have to program the ingress module with a separate 
connection going over the chassis backplane to the module 
with the egress port on it; the egress module would then have 
a connection going from the chassis backplane port to the 
egress port. However, this programming of each of the 
switches can be done through a single switch MIB and agent 
access point (the chassis IP/MAC address). 

8.2.2 The External View : In order to provide a 
logical switch view, the SCS controller or management module 
must do this by '^hiding" the internals of the individual 
switch engines in the chassis. The external view really 
reflects the abstraction of the switching engine. Basically 
a switch engine contains inbound ports, outbound ports, and a 
connection table (see Fig. 7B) . Note that ports are viewed 
as uni-directional such that a two-way connection is 
explicitly defined as two separate uni-directional flows ~ 
one flow from source to destination and another as 
destination to source. 

The external view does not provide any concept of 
aggregation since the external view may describe a logical 
switching system abstraction and not necessarily a real 
device . 

8.2.3 The Internal View ; At the individual "real" 
switching system, an internal view has to be provided which 
is different than the generalized external view. What this 
means is that when a real physical system (device or element) 
is being managed, then the MIB view can provide aggregates 
and other information that is not generalized for switched 
systems. An example is that an individual switch engine can 
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provide aggregate counters for switched packets and for 
errors inside the physical switch device. It is expected 
that the internal view as it is called here is used when 
zooming in to control a very specific device or switching 
element . 

9 . Best Path Determination 

One of the principal functions of the management or 
SCS switch agent 78 (see Fig. 8) is to determine a "best" 
path through the switches for a given set of metrics (see for 
example Fig. 1 and the accompanying text). This is important 
to insuring "fast" transmissions, avoiding bottlenecks 
(excessive traffic on the backplane), and guaranteeing 
quality of service (QOS). Set forth below is one preferred 
method for determining the best path. 

The search method can be described as a concurrent 
breadth first path search through a mesh of nodes and arcs — 
see for example the network topology or mesh of Fig. 1 
wherein the switch S and end point systems M would be nodes, 
and the links L between nodes would be arcs. 

The problem to be solved is to find a path between 
any two points in the mesh which has the following 
properties. The path is optimal for one metric and passes a 
set of threshold tests for n other metrics. Mathematically 

the desired path of all the paths Q^^, , is 

the one whose value v is the best and whose values a, n 

all pass threshold tests A, N. Secondarily, it must do 

this within ai minimxim time constraint T. 

The method assxunes an initial set of values and 
accumulates additional values following the traversal of all 
nodes and arcs along a path until the path arrives at the 
destination or goal node. The method was developed to 
satisfy the requirements of ATM route determination. ATM 
(asynchronous transfer mode) is a new CCITT networking 
technology. The problem is simply to find an optimal path 
through a mesh which satisfies a number of independent 



WO9S/208S0 



PCT/DS95/01026 



- 36 - 

constraints. The solution would be applicable in general to: 
any routing problem in a mesh network such as a communication 
network and/or in electrical and electronic circuit design; a 
distribution of power; a distribution via pipelines; traffic 
routing over streets and highways; etc. 

The method, which is illustrated in the flow chart, 
data structures and example of Figs • 11-13, will first be 
described generally. 

As paths are expanded during a discovery process, 
(n + 1) metrics are altered in a monotonically increasing or 
decreasing function. This is what makes the metrics useful. 
Since some metrics increase or remain the same for each 
traversal and some decrease or remain the same, it is 
confusing to describe them in terms such as larger, smaller, 
etc. Therefore, we will use the terms best, better, worse, 
and worst. For example, a cost metric can be best when it is 
0 and worst when it is some maximum positive value. 
Probability, on the other hand, is best when it is 1 and 
worst when it is 0. A metric which is measured in absolute 
value (i.e.. Impulse fct) would be best at 0 or infinity 
depending upon your viewpoint (i.e., is the impulse desirable 
or undesirable) . At initiation there is a vector of metrics 
which is applied at the source node. At each traversal of a 
node or arc this vector of values is modified and produces a 
traversal value which accumulates from a best state to a 
worst state. 

The method is a breadth first recursive search in 
parallel. It is initiated at a source node with an initial 
set of values and proceeds until there are no further paths 
to explore. It starts with a list of all the neighbors 
(neighboring nodes) of the source node. It then processes 
that list producing another list of all the neighbors of 
neighbors, etc. It uses several methods of "pruning" to keep 
the number of potential paths explored from growing towards 
infinity. A significant feature of this method is the 
pruning steps. 
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As each node is discovered, a traversal value vector 
is recorded for that node* Each time the destination node is 
discovered, the traversal value vector is recorded. 

When a path discovers a node already within the 
path, it terminates itself- This prevents cycles and 
prevents infinite loops. If a path discovers that its 
traversal value vector is not best in any of the (n + 1) 
metrics, it terminates itself. When a path traversal value 
vector has no metric which is better than one of the already 
completed paths, it terminates itself. Any path which would 
traverse a disabled arc or node, terminates itself. Any 
paths whose traversal value vector fails the filters 
(threshold value) in any metric, terminates itself. Any path 
which encounters an end node (i.e., a node which does not 
forward traffic, but may be a source or sink for traffic) 
which is not the destination node, terminates itself. 

For each successive traversal list, all the paths 
going to a single node are grouped together before 
processing. Any of these paths which is not better than the 
others in at least one metric is terminated. 

With the above pruning steps, only paths which can 
potentially produce a best result in some metric are allowed 
to proceed towards the destination. If a filter should knock 
out a promising path, the less promising paths will not be 
blocked as they are in Djikstra (i .e. , Djikstra's short path 
algorithm with filtering). If any path can successfully pass 
the filters, it will get through since all paths which are 
best at something are allowed to continue. 

Once there are no more paths to process, all the 
successful paths are scanned selecting the path which best 
fits the desired result for presentation as the final answer. 

The above steps comprise the most agressive pruning; 
a subset of these steps may be used for less aggressive 
priming . 
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9.1 Example of Best Path Determination 

This specific method was developed for wide, area 
networks (WAN) which have a large number of diverse and 
redundant paths. It is a breadth-first search, which means 
it proceeds in rings moving outwardly from the source node 
(see rings 234A, 234B, 234C, etc. in Fig. 13 moving outwardly 
from source node 1), in order to build a spanning tree. 
Based on the time-constraint and metrics chosen, the farther 
one goes across the mesh, i.e., the farther away from source 
node 1, the higher the probability that one will reach a 
worst case (i.e., a filter threshold). The metrics progress 
monotonically toward a worst case. The algorithm is designed 
to proceed toward multiple destination nodes at the same 
time, and to save more than one path in cache memory so that 
if a first path becomes \inavailable, a second path is readily 
available in the cache. At the same time, the method 
utilizes a number of "pruning" steps or "chokes" for 
eliminating low probability paths, i.e., subpaths which are 
not likely to produce the best path. The chokes prevent 
excessive use of memory space and processing delays which 
would be required if every possible path were saved. The 
amo\mt of pruning applied can be varied as follows: 

• "aggressive" means a traversal value is better in at 
least one metric; 

• "moderate" means a traversal value is better or 
equal in at least one metric; and 

• "light" means a traversal value is better, equal or 
above some threshold level in at least one metric; 
this is used in cases where there is little 
redundancy in the mesh, so that one can save 
multiple values in cache. 

In addition to providing chokes (i.e., pruning 
mechanisms), the method provides "grouping" such that all 
values and paths for the next traversal are stored together 
and processed together as a "computational unit." This 
second feature is also important in satisfying the time 
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constraint. The significance of the chokes and grouping is 
exemplified by the following example, A source code written 
in "python" (i.e., an interpretive prototyping language) 
according to the flow chart of Fig. 11, but without the 
chokes and grouping, provided a search time of about 115 
seconds. Adding the chokes reduced the search time to 40 
seconds. Adding the chokes and grouping reduced the time to 
one second — a 115 time increase in performance. When 
written in C++ language, the one second search time is 
expected to translate into a ten millisecond performance time 
— well within the desired time constraint. 

9.2 Data Structures 
Global Object_VectortO] . A vector of object instances which 
is a property of the Routing Object itself and is created 
when the Routing Object is first initialized. Each Object in 
the Object Vector is the implementation of a metric object. 

Global Node Values [N][Q][V]. A two-dimensional array of 
metric value vectors. There is a vector for each combination 
of node index and qos index that are defined for the Routing 
Object. 

Global Arc Values [AltV]. A one-dimensional array of metric 
value vectors. There is a vector for each arc in the Routing 
Object. 

Global Adjacency [N]. A one-dimensional array (i.e. a 
vector) of lists. Each list represents the adjacencies of 
the corresponding node. Each adjacency is a tuple of the 
neighboring node and the arc between them. A node may appear 
in multiple adjacencies for the same neighbor but must have a 
different, arc index for each appearance. Each arc index will 
appear twice in the Adjacency structure, once for each 
terminating end point. 
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Local PtrSpace, New PtrSpace. Each is an array of records. 
Each record has 3 fields. The Parentfld contains the index 
of the parent of this family of traversals. The Pptr 
contains the pointer within this array of the next parent and 
is maintained in index order of parents. The Vptr contains 
the index of the first value associated with this parent in 
the ValueSpace or New ValueSpace arrays. 

Local ValueSpace, New ValueSpace. Each is an array of 
records. Each record has 3 fields. The Valuefld contains 
the metric value vector of the aggregate values to this point 
in the traversals. The Vptr contains the index within this 
array of the next metric value vector for the parent family 
of traversals. The Pathptr contains the index into the 
PathSpace/NewPathSpace array for the first path of this value 
vector . 

Local PathSpace, New. PathSpace . Each is an array of 
records. Each record has 2 fields. The Pathfld contains the 
path to this point for the traversals. The Npptr contains 
the index within this array of the next path for this value 
vector. A Path is a list of lists. The first list is a 
sequence of node indices in the order of visits during the 
traversal. The second list is a sequence of arc indices in 
the order of visits during the traversal. 

Local Workhead, New Wrkhead Integer. The index within 
PtrSpace/NewPtrSpace of the fist parent within a ring or the 
next to be processed in a ring. Workhead, PtrSpace, 
ValueSpace, and PathSpace is the current concentric ring of 
traversals that is being processed and New Wrkhead, New 
PtrSpace, New ValueSpace, and New PathSpace are the next ring 
to be worked on. We build the next ring while we are 
processing the current ring. 
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Local Output. Output is an array of records. The first 
field of each record is a completed path from source to 
goal. The second record is the aggregate values for that 
path. Thus, each .entry in Output is a completed path. 

Local Best Value is a tuple of metric values. The first is 
the best primary value of a complete path seen to this point 
in the processing. The second is the best secondary value 
seen to this point in the prociessing. 

All Value Vectors are in the same order as defined by the 
objects in Object.Vector ANT ARE NOT necessarily in the same 
order as their owning objects within Object_Vector . Their 
position is established when the metric objects are 
initialized. 

Route Path has the following formal parameters: 
Source, Goal, Primary Valuelndex, Secondary Valuelndex, 
lnitial_Values, QOS, Filters and Returns a vector: exception, 
path, values. 

Parameter Source Integer. The source node index of the path. 

Parameter Goals List of Integers. The destination node 
indices of the possible paths. It may be a single node or 
multiple nodes. 

Parameter PrimaryMetricIndex Integer. The index within 
Object_Vector of the metric object for which this path is to 
be optimal . 

Parameter secondaryMetricIndex Integer. The index within 
Object Vector of the metric object which is the second 
precedence for optimization of this path. 
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Parameter InitialValue Vector of Metric Values. These are 
the assigned metric values for this path. If this call to 
the Routing Object is in isolation of all other calls, this 
should be a vector of best values- However, if this call is 
made in conjunction with other calls to establish a path 
across multiple domains, this value will be a value returned 
from a preceding call to this Routing Object or another which 
represents an adjacent domain. 

Parameter QOS Integer. This is the index for the QOS desired 
for this path. 

Parameter Filters Sequence of tuples. Each tuple has an 
index for a metric object within Object_Vector and an 
aggregate threshold value for that metric object. For 
example, when cost is the metric object and it has an index 
of 4 within Object_Vector , (4,40) means reject all paths 
whose cost is equal to or exceeds 40, 

Return Parameter Exception Enumerated Integer. 0 is a 
successful path. 1 is a successful call which determined 
that no path from source to destination met the constraints. 
Any other value indicates failure, the most common value 
being 3 which is an incorrect or inconsistent value for a 
formal parameter. 

Return Parameter Path. A list of arc indices in order of 
traversal from source to goal. 

Return Parameter Values. A vector of metric values which 
represents the aggregate of the InitialValues and all Node 
and Arc Traversals within the path up to but not including 
traversal of the goal node. 
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9.3 Flow Chart 

Referring to Fig. 11, step 200 is an initialization 
of the values, wherein "source" refers to the source node 
address, "goals" refers to the one or more destination node 
addresses, "pindex" refers to the primary metric, and 
"sindex" refers to the secondary metric which is used to 
select the best path if the primary metrics for two paths are 
equal. The "initial_value" is a vector of all initial values 
for the metrics which may come from the management system. 
In a wide area network where there may be a plurality of 
management systems managing different areas in the network, 
the best path determination may proceed from one sub-area to 
another and the initial values may come from the best path 
determination of an adjacent sub-area. If this is the first 
system to determine the best path, then the initial values 
will be the best values of the metrics. The "QOS" defines 
the quality of service for the various types of 
transmissions, such as voice, video or data, and provides 
static filters which do not change over time. The "filters" 
are dynamic filters such as call blocking probability, peak 
cell rate, etc., which are required to change over time. 

Following initialization, the method proceeds to 
step 201 wherein the value of the data structure "Workhead" 
is checked. As shown in Fig. 12, the data structure's 
Workhead 230, Ptrspace 231, Valuespace 232 and PathSpace 233 
form a chain of linked data structures, each with an array of 
records. PtrSpace and ValueSpace each have three fields, 
while in PathSpace each record has two fields. These linked 
data structures illustrate how the values and paths for the 
next traversal are stored and processed together as a 
computational iinit. 

During the first traversal, the Workhead will not be 
"none" and we proceed to step 202 wherein we obtain the value 
of parent (the next node) from PtrSpace. At this time we 
also set the Workhead equal to the next parent pointer, to 
get ready for the next traversal. We proceed to step 203, 
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wherein the Parentvalues are set equal to the values for the 
parent from the Nodevalues. The Nodevalues are the values of 
the metrics of that node. Proceeding to step 204, we get the 
"Neighbor list" of adjacent nodes to the parent. Proceeding 
to step 205, we check whether the Neighborlist is empty, and 
if not, we proceed to step 206 to get the next neighbor 
(node) and arc from the next tuple in the Neighborlist. 
During this next portion of the flow chart from steps 206 to 
210, we are processing the values. We then proceed to step 
207 to check if the neighbor node is the same as the parent; 
if so, we do not need to check this path (it has already been 
traversed) and we terminate it (this is one of the chokes). 
Next at step 208 we check to see if the arc or neighbor is 
disabled or if we have reached an end node which is not one 
of our goals, in which case we would terminate (i.e., another 
choke) . We then proceed to steps 209 and 210 to check the 
value of the secondary metric. We now enter a new portion of 
the flow chart from steps 211 to 217 where we iterate the 
values. At step 211, we get the values from the data 
structure ValueSpace (232 in Fig. 12) and proceed through 
steps 213-215 to determine if there is any metric in Values 
which is better than in Nodevalues, i.e, the values of the 
metrics up to that node. If this is not a better path in any 
one metric, then we terminate the path. If not, we proceed 
with step 216 to record the better values into Nodevalues, 
and proceed to step 217 to determine whether the Nodevalues 
pass the threshold filters for each of the metrics. If they 
do, we proceed to step 218 and now enter the portion of the 
flow chart where we iterate the paths. In step 218, we first 
check to see whether we have reached the destination node. 
If we have, we proceed to steps 219 and 220 to check whether 
the primary metric is the best compared to all previous 
paths. If not, we terminate the path. If it is, we proceed 
to step 221 to output the path as the best path 
determination. 



wo 95/20850 



PCT/US95/01026 



- 45 - 

Returning back to step 218, if we have not reached 
the destination node, we proceed to steps 222-223 to check 
whether this path has produced the best value for the primary 
metrics and then proceed to step 224 to proceed onto the next 
Workhead. 

Returning to step 225, we initialize a new 
traversal. If we have reached the end of our traversals and 
there is no path which meets all of the constraints, we 
proceed through * steps 226 and 229 to report that no path has 
been found. Alternatively, if we have a successful result we 
proceed to steps 226-228 and record the best path. 

Fig. 13 illustrates a series of traversals from 
source node 121 to destination node 130. The search proceeds 
in concurrent rings as illustrated by 234A, 234B, 234C, etc. 
The various dashed and dotted lines show different paths from 
source node 121 to intermediate node 129. In this case, the 
traversal of the nodes 121-129 can have six paths, and three 
paths have been found to arrive at node 129 with equal 
values. In this case, we would not need to check the 
individual metrics of each of the three paths with the next 
traversal to node 130, since they are all equal; rather, we 
can simply check the next traversal against the metrics of 
one path. This time savings is enabled by the grouping of 
values and paths in the linked data structures shown in Fig. 
12. 

10 . Allocation of Bandwidth 

10.1 Discussion of the Related Art 

In computer networks and controllers, sharing of 
bandwidth-limited resources is commonly required. 
Bandwidth-limited resources may be hardware or software 
resources. Examples of bandwidth-limited, shared hardware 
resources are peripheral devices such as printers, scanners, 
memories, disk drives and backplane communication links. 
Backplane communications links are used to connect modules in 
a device, such as a computer, a network controller, or a 
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network hub such as a bridge or a router. Examples of 
bandwidth-limited, shared software resources are processes 
such as compression/decompression algorithms, and memory 
access algorithms,. These resources are referred to as 
bandwidth-limited because their bandwidth limits the rate at 
which data can be transferred to, from, or by the resource. 
Within this disclosure, the term bandwidth-limited, shared 
resource is meant to refer to a device or process having a 
bandwidth limit that determines the rate of transfer of data. 

In a system such as a local area network bridge or 
router, a number of modules are contained in a chassis. Each 
of the modules has one or more ports to which may be 
connected users or other network segments. The modules are 
connected together via a backplane communication link over 
which data is transferred from one module to another 
resulting in the data being transferred from one port on one 
module to a port on another module. This backplane 
communication link, although typically having a high 
bandwidth and resulting high rate of data transfer (typically 
from several hundred megabits per second to several gigabits 
per second), is the limiting factor in determining how 
quickly data is transferred from one port on one module to 
another port on another module, because the backplane 
communication link can serve only one port at a time. 

To ensure that all of the ports connected to the 
networking chassis have access to the backplane communication 
link, some type of arbitration is typically employed. Each 
of the ports on a module connected to the networking chassis 
may be considered a "competing device" that competes, along 
with all of the other ports connected to the networking 
chassis for access to the backplane communication link. 
Within this disclosure, the term "competing device" is meant 
to refer generally to any type of hardware device, software 
process, or firmware, or application program that is to make 
use of a bandwidth-limited, shared resource. 
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One approach to arbitrate between the competing 
devices has been to provide what is known as time division 
multiplexing (TDM), In a TDM arbiter, a time segment is 
determined, A time segment is a xinit of time, typically 
fixed, during which a competing device would be allowed 
exclusive use of the bandwidth-limited, shared resource. One 
time segment is assigned for each competing device. If there 
were ten competing devices, then there would be ten time 
segments. Each of the competing devices is then assigned to 
one of the available time segments. This information is then 
used by a state machine that increments through each time 
segment to allow the particular competing device assigned to 
that segment to use the backplane communication link for its 
assigned time segment. After the state machine has stepped 
through all ten devices, the process loops back to the first 
segment and begins again. This results in each competing 
device being able to use one-tenth of the available bandwidth 
of the bandwidth-limited, shared resource. 

In a TDM arbiter, the users of each time segment are 
fixed. For example, the first segment is always assigned to 
a particular port on the network chassis and the ninth 
segment is assigned to another particular port on the 
networking chassis. One of the problems with this type of 
arbiter is that if the port that is allocated to a time 
segment is not requesting use of the backplane comm\inication 
link at the time the TDM arbiter allows it to do so, then 
that time segment will be wasted and the backplane 
communication link is idle during the assigned segment. 

Another way to allocate the time segments of a 
bandwidth-limited, shared resource such as a backplane 
communications link is to use a so-called "Roxind-Robin" 
arbitration system. In a Round-Robin system, a list of the 
competing devices is compiled and stored. An allocation 
token allowing exclusive use of the backplane communications 
link is then passed among the list of competing devices, for 
example, in a sequential manner. By applying sets of rules 



wo 95/20850 



PCT/DS95/01026 



- 48 - 

to the allocation token, the token can be passed to a device 
that is not necessarily the next device in the list, thus 
allowing for some prioritizing of allocation among competing 
devices. The competing device that is in possession of the 
allocation token is then allowed to use the backplane 
commujiication link for a particular time period. One problem 
with this type of arbitration system is that if the device in 
possession of the allocation token does not require use of 
the backplane communication link, the backplane communication 
link is unused and idle for the particular time segment. 

Other types of fixed allocation systems may be used 
that determine, at the beginning of a particular time 
segment, which competing device is to be allowed exclusive 
access to the backplane communication system. One problem 
with fixed allocation systems is that the arbitration 
requires a portion of the time segment to determine which 
competing device should use that particular time segment. 
Therefore, the rate at which data can be transmitted across 
the backplane communications link is reduced because a 
portion of the time segment must be used to perform 
arbitration. 

Another disadvantage of the TDM and Roxind-Robin 
arbiters is that the latency of transmission of, for example, 
a data packet, may be increased due to the wasted time 
segments. That is, although a data packet from a particular 
port may be waiting and ready for transmission across the 
backplane communication link, the data packet cannot be 
transmitted \intil the TDM arbiter allows the port access to 
the backplane commujiication link or the Rotind-Robin token is 
allocated to the port. 

Therefore, an object of the present invention is to 
provide a method and apparatus for arbitrating access to a 
bandwidth-limited, shared resource in a manner that improves 
latency through a bandwidth-limited resource. 

Another object of the present invention is to 
provide a method and apparatus for accessing bandwidth- 
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limited, shared resources that allows the bandwidth-limited 
resource to be used whenever there is a competing device 
requesting access to the bandwidth-limited resource. 

Another object of the present invention is to 
provide a method and apparatus that allows a 
bandwidth-limited resource to service competing devices that 
have a total aggregate bandwidth greater than the bandwidth 
of the bandwidth-limited, shared resource. 

Another object of the present invention is to guarantee 
different quality of services to different competing devices 
depending upon priorities of the competing devices. 

10.2 New Apparatus And Method 
For Allocating Bandwidth 

For purposes of illustration only, and not to limit 
the generality, the present invention will now be explained 
with reference to its use for allocating time segments of a 
backplane communication link (a bandwidth-limited, shared 
resource) in a networking chassis. One skilled in the art 
will recognize that the present invention is generally 
applicable to allocation of time segments of any type of 
bandwidth-limited resource to a number of competing devices. 
For example, the present invention may be used to control 
access to a local bus, a switch, a disk drive, a memory bank, 
or a software process. 

Fig. 14 illustrates a networking chassis 410 that 
may be, for example, a bridge, router, or hub. The chassis 
contains a number of slots that can receive plug-in modules 
412-1 through 412-N. A backplane including a communication 
link 416 connects the modules together to provide data 
transfer and control. Each of the modules 412 includes an 
arbitration circuit 414 that controls access to backplane 
communication link 416. The modules contain a number of 
ports 1-n to which devices that require use of the backplane 
communication link 416 are connected. The networking chassis 
410 is described more fully in a copending and commonly owned 
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application entitled Distributed Chassis Agent For Network 
Management, by Brendan Fee et alw filed on even date 
herewith, the disclosure of which is incorporated herein by 
reference in its entirety. In the networking chassis 410, 
the backplane communications link has a bandwidth of 4 
gigabits. Each of the devices 1-N, which may be peripherals, 
workstations, network segments, bridges, routers, or other 
hubs, compete for access to backplane communication link 416 
in order to transmit data from one device to another. 

Fig. 15 illustrates one embodiment of arbitration 
circuit 414 illustrated in Fig. 14. In accordance with the 
method described 'in the above-described copending application, 
one or more of the arbitration circuits 414 is chosen to act 
as arbiter for all of the competing devices connected to all 
the ports of all modules 412. 

Arbitration circuit 414 includes a set of status and 
control registers 418 that are used to control access to 
memory 422 and arbitration engine 424 by the CPU (central 
processing unit, not shown) that is acting as the chassis 
control agent in accordance with the method and apparatus 
described in the . copending application. The data transceiver 
426 provides any necessary interface between communication 
link 416 and memory 422 and latch 428. Communication link 
416 is typically a multibit bus. The latch 428 is used to 
transfer data from memory 422 or data transceiver 426 to the 
arbitration engine 424. An address generator 430, which may 
be a counter, is used to incrementally generate addresses for 
reading and writing data and control information into and out 
of memory 422. 

The arbitration engine 424 arbitrates between 
requests received from devices on bus 432 to allocate time 
segments of backplane communication link 416 to the competing 
devices using control bus 434. Lines 436 and 438 are used to 
provide appropriate initialization and control signals. 

The first step in setting up the arbitration 
mechanism of the present invention is to program the length 



wo 95/20850 



PCTAJS95/01026 



- 51 - 

Of the time segments and the order in which the time segments 
are to be allocated. The time segments are typically of 
equal length and the length of a particular time segment is 
dependent upon a particular application, the architecture of 
the communication link 416 and its bandwidth (or the 
architecture and bandwidth of the particular bandwidth- 
limited, shared resource that arbitration circuit is to 
control). For example, if communication link 416 is a bus 
that is only a few bits wide, the time segments need to be 
shorter time intervals so that data can be moved quickly. In 
a like manner, if the communication link 416 is a bus having 
a relatively wide width (i.e., 32 or 64 bits), then the time 
segments may be longer time intervals to provide the same 
bandwidth . 

The first level of arbitration performed by 
arbitration circuit 414 is a programmable time division 
multiplexing type arbitration. Memory 422 is used to provide 
this programmability. After memory 422 has been programmed, 
arbitration engine 424 operates basically as a state machine 
wherein the states determine which competing device is to be 
allocated a time segment as a function of the information 
programmed in memory 422. Each location in the memory is 
programmed with information indicating which competing device 
is to have access to the next time segment to be allocated. 
After the arbitration is performed, address generator 420 
increments the memory location so that when arbitration 
engine 424 accesses the memory during the next state of the 
state machine, information as to which competing device has 
rights to exclusive use of communication link 416 is 
available. 

Figs. 16 and 17 illustrate some examples of how the 
state machine might be programmed and operate. Fig. 16 
illustrates the case where all of the competing devices are 
given equal bandwidth. In state 1, competing device 1 has 
been programmed in memory 422 as the competing device 
allocated to the first time segment. In state 2, competing 



wo 95/20850 



PCTAJS95/01026 



- 52 - 

device 2 has been programmed as the competing device 
allocated to the second time segment • In state 3, competing 
device 3 has been programmed as the competing device 
allocated to time segment 3. In state 4, competing device 4 
has been programmed as the competing device allocated to time 
segment 4. From state 4, the state machine returns to state 
1 and continues processing. Although only four states and 
four devices have been illustrated, one skilled in the art 
will appreciate that the state machine would have as many 
states as there are devices and memory 422 would have at 
least as many memory locations for devices as there are 
competing devices. As is evident from Fig. 16, each competing 
device has been allocated one-quarter of the available 
bandwidth . 

Fig. 17 illustrates an embodiment in which the time 
division multiplexing arbiter has been programmed to allocate 
the bandwidth unequally. In state 1, the time segment is 
allocated to competing device 1. In state 2, the time 
segment is allocated to competing device 2. In state 3, the 
time segment is allocated to competing device 1 again. In 
state 4, the time segment is allocated to competing device 
3. In state 5, the time segment is allocated again to 
competing device l. In state 6, the next time slice is 
allocated to competing device 4. From state 6, the state 
machine returns to state 1 and processing continues. As is 
evident from the programmed time division multiplexing scheme 
illustrated in Fig. 17, competing device 1 has been allocated 
1/2 of the available bandwidth of communication link 16 and 
the remaining one-half bandwidth has been allocated equally 
among competing devices 2, 3, and 4. Thus, if competing 
device 1 required more bandwidth or was a higher priority 
device, memory 422 can be programmed to accommodate these 
needs . 

One skilled in the art will appreciate that other 
state machines can be developed along this principle to 
allocate the bandwidth as needed to various competing 
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devices. As also illustrated in Fig. 17, the programmable 
time division multiplexing arbitration system provides a 
first level of arbitration that can be used to assign 
priorities for access to coramxinication link 416 among the 
various competing devices. 

Fig. 18 illustrates one of the features of the 
present invention in which arbitration and allocation of time 
•segments are performed during the data transfer cycle just 
prior to the cycle in which the time segment is to be used. 
In step 450, the system is initialized. Initialization 
includes programming memory 422. From step 450, the system 
proceeds to step 452 in which a first arbitration and 
allocation step to allocate the first available time segment 
is performed. This step corresponds to, for example, 
determining in state l of Figs. 16 or 17,; which device is 
entitled to exclusive access to communication link 416. 

From step 452, the system proceeds to step 456 in 
which another arbitration and allocation step is performed. 
During arbitration and allocation step 456, the system also 
proceeds in step 454 to allow a data transfer across 
communication link 416 by the con^jeting device determined in 
step 452. From step 456, the system proceeds to step 460 in 
which another arbitration and allocation step is performed. 
At the same time that arbitration and allocation step 460 is 
being performed, a data transfer across commxinicat ions link 
416 by the device determined in step 456 is being performed. 
As illustrated by time scale 451, during time interval T^, 
step 450 is performed and during time interval T^, step 452 
is performed. During time interval Tj, steps 456 and 454 
are performed and during time interval Tg, steps 460 and 
458 are performed. Time intervals T^ - T^^ are equal 
sized time intervals. The system continues in this mode of 
arbitrating and allocating the next available time segment in 
parallel with a data transfer that is already occurring. 
Although this results in a penalty because one extra 
arbitration and allocation step (namely step 452) must be 
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performed before the first data transfer can occur, once this 
first arbitration and allocation has been performed, the 
system operates with improved efficiency because allocation 
and arbitration and data transfer occur simultaneously. In 
particular, the next available time segment is arbitrated and 
allocated during the time segment of the previous data 
transfer . 

Referring again to Figs. 15, 16 and 17, one 
additional feature of the present invention is the inclusion 
of a "wrap" register 421 in address and control generator 
420. Wrap register 421 is programmed to reset address 
generator 430 and memory 422 to their first addresses when 
all of the states of the state machine have been processed. 
For example, if memory 422 contained 2,000 locations, address 
generator 430 will control the memories to sequence through 
all 2,000 addresses until the counter reaches its upper limit 
and turns over. However, in the situation where there are 
fewer than 2,000 states in the state machine, as illustrated 
in Figs. 16 and 17, further improvements in efficiency can be 
obtained by programming wrap register 421 vith the highest 
state of the state machine (and/or the highest address 
location of the memory 422). For example, in Fig. 17, wrap 
register 421 would be programmed to indicate that the highest 
state in the state machine is state 6 and would also contain 
the highest programmed address in memory 422. In each state 
of the state machine, a check is made of wrap register 421 to 
determine whether or not the state machine has reached its 
last state. If the answer is yes, the state machine loops 
back to state 1 and processing continues. On the other hand, 
if the check indicates that the last state of the state 
machine or the highest addrisss in the memory has not been 
reached, then the state machine and address are incremented 
to the next state and address, respectively. 

The programmable arbitration system of the present 
invention provides a first level of arbitration and allows 
competing devices which require deterministic service 
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policies such as isochronous devices to be serviced with 
other nondeterministic devices trying to access the 
communication link 416. This fixed allocation system also 
guarantees that the bandwidth needed to service an 
isochronous device is always available. 

Reference is now made to Fig. 19 which illustrates 
the method of the present invention including all three 
levels of arbitration. As will be described, the second and 
third levels of arbitration, when competing devices have been 
programmed to use them, allow unused time segments to be 
allocated to other competing devices in order to improve 
system performance. 

In step 500, the arbitration circuit 414 is 
initialized. Initialization includes assigning each 
competing device an identification number and assigning time 
segments to these identification numbers as illustrated in, 
for example. Fig. 17. One skilled in the art will appreciate 
that a competing device may be prohibited from participating 
in the first level of arbitration by not assigning it a time 
segment. In addition, a list of the competing device 
identification numbers is also stored in memory 422 and an 
allocation token is assigned to one of the competing device 
identification numbers. Also, initialization includes 
programming, into memory, which levels of arbitration a 
competing device may participate in. from step 500, the 
system proceeds to step 502. 

In step 502, the TDM state machine programmed in 
accordance with, for example. Fig. 16 or 17, is initialized 
and a first arbitration and allocation step, such as step 452 
in Fig. 18, is performed. From step 502, the system proceeds 
to step 504 in which the system goes to the first state of 
the programmed state machine. From step 504, the system 
proceeds to step 506. In step 506, the system determines 
which competing devices are requesting use of communications 
link 416 by monitoring request signals received on, for 
example, bus 432 in Fig. 15. From step 506, the system 
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proceeds to step 508. In step 508, the system determines 
whether any requesting device identification number ec[uals 
the identification number that has been programmed for the 
next state of the state machine. If the answer is yes in 
step 508, the system proceeds to step 510 in which the time 
segment is allocated to the requesting device identified in 
step 508. On the other hand, if the answer in step 508 is 
no, the system proceeds to step 512. 

In step 512, the system determines whether any 
requesting device identification number equals the 
identification number of the device associated with the 
allocation token that was assigned in initialization step 
500. This provides a second level of arbitration. The 
system also checks if the requesting device has been 
programmed to participate in the second level of 
arbitration. If the time segment remains unallocated after 
the first level of arbitration in step 508, the system 
provides a second level of arbitration, in step 512, to 
attempt to assign the unused time segment to another 
competing device. If the answer is yes in step 512, the 
system proceeds to step 514 in which the system determines 
whether the device identified in step 512 is presently using 
the bandwidth-limited, shared resource, i.e., the 
communication link 416 illustrated in Figs. 14 and 15. The 
purpose of step 514 is to prevent one of the competing 
devices from hogging the communications link for multiple 
time segments. If the answer is no in step 514, the system 
proceeds to step 516 in which the time segment is allocated 
to the requesting competing device identified in step 512. 

Returning to steps 512 and 514, if the answer is no 
in step 512 or yes in step 514, the system proceeds to step 
518. Step 518 provides a third level of arbitration that 
attempts to make use of the unallocated time segment if the 
first two levels of arbitration have not assigned the time 
segment . 
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In step 518, the system determines whether there is 
a requesting competing device having the lowest 
identification n\imber in the list of competing devices and 
whether that device has been programmed to participate in the 
third level of arbitration. If the answer is yes in step 
518, the system proceeds to step 520 and allocates the time 
segment to the requesting competing device identified in step 
518, From step 520, the system proceeds to step 522. 
Returning to step 518, if the system determines that there is 
no device waiting to use communication link 416, then the 
time segment goes unallocated and the system proceeds to step 
522. One skilled in the art will appreciate that although 
the third level of arbitration is illustrated as assigning 
the time segment to the device having the lowest 
identification number, clearly other allocation schemes could 
be substituted for this step. For example, the time segment 
could be allocated to the device having the highest 
identification number in the list of competing devices. More 
generally, the third level of arbitration allocates the time 
segment to the requesting competing device having a 
predetermined rank in the list of competing devices. The 
predetermined rank may be the lowest identification niimber, 
the highest identification number, or the identification 
nximber in the middle of the list, for example. 

Returning to steps 510 and 516, the system also 
proceeds to step 522 after these steps. In step 522, the 
allocation token is passed to the next competing device in 
the list of competing devices. 

From step 522, the system proceeds to step 523 in 
which an enable signal is sent to the competing device 
selected in steps 510, 516, or 520. 

From step 523, the system proceeds to step 524. In 
step 524,* the wrap register is checked to determine if the 
last state of the state machine or the last programmed memory 
location has been reached. If the answer is yes in step 524, 
the system proceeds to step 504, returning to the first state 
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Of the state machine, and processing continues as already 
described. On the other hand, if the answer in step 524 is 
no, the system proceeds to step 526. In step 526, the 
address of memory 422 is incremented and the state machine 
goes to the next sequential state. From step 526, the system 
proceeds to step 506 and processing continues as already 
described. 

As can be seen from an examination of Fig. 19, once 
the system has proceeded through a first arbitration and 
allocation cycle, the allocation and arbitration steps 
proceed in parallel with data transfers occurring during a 
time segment. That is, the system is proceeding through 
steps 500-522 while the competing device that had been 
enabled as a result of step 523 in the prior arbitration and 
allocation cycle is performing a data transfer. 

The present invention provides a n\Knber of, 
advantages. Typically, conventional TDM type arbiters are 
hard-coded logic implementations that are not programmable 
and not easily used in other applications once designed. The 
present invention, on the other hand, being a programmable 
memory-based device, is not only programmable, but the same 
hardware can be used in other applications. The programmable 
memory also allows the present invention to be configured to 
allow any time segments or mix of time segments to be 
assigned to a bandwidth- limited, shared resource rather than 
having the resources assigned to the same segment in every 
implementation . 

The present invention provides a system in which 
competing devices that require deterministic and regular 
service policies can be accommodated, as well as devices that 
can arbitrarily make use of a bandwidth- limited, shared 
resource. In addition, the present invention allows unused 
time segments to be allocated to devices that can make use of 
thjBm, thus improving the latency of data transmission to or 
through the bandwidth-limited, shared resource, if the 
competing devices are programmed to participate in the second 
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and third levels of arbitration- A device can be selected to 
participate in the second level of arbitration by simply 
including it in the list of devices that may receive the 
allocation token. • Deleting a device from this list will 
prevent it from participating in this level of arbitration. 

The present invention, since it allows unallocated 
time segments to be used by competing devices that have not 
been specifically programmed for a time slice, provides the 
ability to "over-s\ibscribe" the bandwidth-limited, shared 
resource. For example, the bandwidth- limited, shared 
resource may have a bandwidth of 20 megabytes per second, but 
the maximum aggregate bandwidth of all of the competing 
requesting devices could be, for example, 25 megabytes per 
second. In previous systems, the allocation of bandwidth 
would have forced some or all of the devices to operate at 
less than full speed due to the bandwidth limitation of the 
resource. The present invention allows the unused time 
segments of less active devices to be used by the busier 
devices. This allows full speed bursts by competing devices 
to proceed with no hindrance. Thus, the maximum aggregate 
bandwidth can be greater than the bandwidth of the 
bandwidth-limited, shared resource. 

One way of achieving oversubscription is to assign 
time segments in the first level of arbitration to only some 
of the competing devices, such as those requiring a regular 
or deterministic type of service policy. The remaining 
competing devices are then programmed to compete in the 
second and third levels of arbitration to use unallocated 
time segments resulting after the first level of arbitration. 
Another way to use the present invention to achieve 
oversubscription is to assign time segments in the first 
level of arbitration to all of the competing devices to 
guarantee that each device has at least one opportunity to 
use the bandwidth-limited, shared resource. The lower levels 
of arbitration are then used to allocate unused time segments 
resulting after the first level of arbitration, thus 
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improving the latency through the bandwidth-limited, shared 
resource. 

The present invention may be implemented in a 
variety of ways. For example, the invention can be 
implemented completely in software, completely in hardware, 
or in a combination of both. As illustrated in Fig. 15, 
memory 422 can be implemented as static RAM, dynamic RAM, 
novRAM, or proms. The control circuitry of address generator 
430, data transceiver 426, and latch 428 can be fabricated 
from standard TTL devices, CMOS devices, or incorporated into 
single chip implementations such as PALS, FPGAs, or ASICS. 

Having thus described one particular embodiment of 
the invention, various alterations, modifications, and 
improvements will readily occur to those skilled in the art. 
For example, one skilled in the art will appreciate that the 
present invention may be applied outside the field of 
computer networks to any system that requires sharing of a 
bandwidth-limited resource among competing devices, such as a 
memory bank or a disk drive in a standalone computer system. 
Additionally, although a hierarchy of three levels of 
arbitration has been discussed in detail, any number of 
levels of arbitration can be used depending upon the 
particular characteristics of the bandwidth-limited, shared 
resource and the environment in which it is used. Such 
alterations, modifications, and improvements are intended to 
be part of this disclosure, and are intended to be within the 
spirit and scope of the invention. 

10.3 Example of Bandwidth Allocation For 
SFPS Module 

In this example, the previously defined multi-level 
programmable arbitration is applied to module 32 plugged into 
networking chassis 30 (see Fig. 4). The module 32 includes 
an SFPS switch 40, as shown in Fig. 5; the internal operation 
of the SFPS switch was previously described with regard to ^ 
Fig. 2. The multilevel programmable arbiter (MPA) 13 {shown 
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in Fig. 2) incorporates the arbitration scheme described in 
the previous section. 

The module 32 includes 12 Ethernet ports (see for 
example Ethernet port interface 44 in Fig. 5), one backplane 
port (INB backplane interface 50 in Fig, 5), and one CPU port 
(host processor 41 in Fig. 5). In this example, we assign a 
time slice to each Ethernet port and then allocate a slice to 
the backplane for each Ethernet that is present. This covers 
the worst case situation of all 12 Ethernets sending traffic 
to the backplane. In this example, we assign half the 
bandwidth to the backplane and the remainder to the Ethernet 
ports . 

In this particular application, the switch 40 
provides 640 Mbits of bandwidth. Each Ethernet port gets 
25.6 Mbits of bandwidth allocated to it, which is more than 
enough for their needs. The total Ethernet bandwidth is 
approximately 120 Mbits/sec and the backplane has been 
allocated 307 Mbits/sec and can therefore pass all the 
traffic the Ethernets could generate. The host or CPU has 
only been allocated one slice out of 25 (25.6 Mbits/sec) 
which if not enough can be supplemented by enabling the round 
robin and lowest level arbitration cycles so the CPU can also 
use unclaimed time slices. If desired, the backplane and 
Ethernet ports can also have the second and third level 
arbitrations enabled. While there is no bandwidth requirement 
in this example that would warrant doing so, it may improve 
module latencies by allowing these ports time slices earlier 
than they would normally receive them. 

Fig. 20 illustrates on the right, the TDM ram 
programming (first level arbitration) with ram location 
addresses 0-24 allocated to the designated Ethernets (ports 
1-12), backplane (port 0), and host CPU (port 13). The wrap 
register is set at address 24 so that the TDM will loop back 
to the first address. The ram is traversed in 25 x 400nsec, 
or approximately lOusec; the rate of traversal is lOOk/sec. 
Thus, each Ethernet gets 100k x 256 bits, or 25.6 Mbits/sec. 
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The host gets 100k x 256, or 25.6 Mbits/sec. The backplane 
gets 100k X 256 x 12, or approximately 307 Mbits/sec. At the 
second level of arbitration (not shown), the round robin 
token continually circulates between all those devices 
enabled to use it. Similarly, the third level of arbitration 
is available to those devices enabled to use it, and awards 
the unused time slice to the lowest requesting device 
participating in the third level arbitration. 

While this example does not seem to put any 
stringent requirements on the niomber of slices given a port 
or how frequently the slices need to appear in the TDM ram, 
the ports themselves will put requirements on how often they 
need a slice. For example, the Ethernet ports have 32 byte 
pre-staged fifos that need to be filled or emptied within a 
certain time interval. The Ethernet ports having 32-byte 
fifos need a data transfer of 32 bytes every 32 x 800 nsec or 
25.6 usee. This means that each Ethernet port needs its port 
ID programmed at no less than a 25.6 usee interval in the TDM 
ram to insure that no overflow or underflow occur for the 
device. The 25.6 usee translates to 64 time slices in the 
TDM ram. As long as the slices for a particular Ethernet 
port are not further apart in the ram than 64 addresses, no 
under or over rxins of data will occur. FDDI ports would 
require a different bandwidth allocation. 

11 . SFPS Software Object Model 

A complete functional model of the SFPS may be 
implemented as software objects within the firmware 
architecture. The SFPS is integrated within the generalized 
system architecture which allows it to be a logical 
application within the system and have access, to the 
resources and communication device drivers. 

11.1 SFPS Objects 

All of the embedded SFPS is implemented within 
software objects. Objects are data constructs and associated 
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software that together form an autonomous entity with a 
private and public interface. The goal of the software-based 
SFPS is be portable across many products and platform 
architectures. Fig. 21 illustrates this system. The 
following high-level SFPS software objects are 
platform-independent — that is to say they are common across 
different system architectures: 

• SFPS Application Object 600 

• SFPS Switch Object 601, 

In addition, SFPS uses application threads 602 that 
provide external control and access to the SFPS switch. 
These applications run as clients within a client/server 
framework. In most cases, the server is either a Network 
Management System or a Connection Server. 

These application threads are as follows: 
SFPS Switch Agent 603 

• SFPS Call Processor 604 

• SFPS Discovery Agent 605 

11.1.1 SFPS Application Object 

This object is instantiated at system start-up by a 
Resource Manager which is responsible for sizing the system 
and allocating the system device drivers, system resources, 
and applications. SFPS, at this high level, is instantiated 
as an Application Resource Object. Within the object 
constructor, the SFPS Application object instantiates the 
SFPS Switch Object and the SFPS Application Threads. This 
SFPS Application Object provides the high-level control and 
access to all of the objects and threads which are part of 
the SFPS switch. 

11.1.2 SFPS Switch Object 

The SFPS Switch Object contains the objects which 
make up the portable SFPS Switch. As a high-level object, 
the SFPS Switch object contains (through instantiation) the 
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sub-objects which provide the SFPS switch f\inctionality. 
These are the Connection Table Object 606, InPort Objects 
607, the OutPort Objects 608, and the Switch Engine Object 
609. 

Connection Table Object - Provides the data and 
methods for maintaining the cross connect mapping of in-ports 
and out-ports for each connection. It is indexed, in order, 
by SFPS connection-identifiers. Connection-identifiers are 
formed by combining the source-port, the source MAC address, 
and the destination MAC address of the end stations for which 
a connection is defined. Note that multi-party connections 
will have a list of out-ports within the Connection Table. 
The Connection Table is an AVL-tree (a balanced binary tree) 
which can grow to arbitrary size. Currently, a maximxim of 
16,000 connection entries are supported. In addition to 
providing internal access for the Switch Engine, it also 
provides call accounting information on each active 
connection as well as the managed object view for remote 
management . 

Port Objects - Provides the data and methods for 
configuring and accessing the physical media ports for 
in-bound and out-bound traffic. As illustrated in Fig. 22, 
these Port objects 610 are objects that allow SFPS-specif ic 
use of physical switch ports 611 within the system. In 
firmware-based systems, these objects access the physical 
port through a Framing Object 612 which hides the 
media-specific framing characteristics of the communication 
datalink. The Framing Objects, in turn, interface with the 
media-specific device driver 613 through a common datalink 
Interface Object 614 and packet memory which is described and 
accessed with Packet Control Structures (PCS) 615. To 
provide bandwidth control and rate limiting, these objects 
have transmit and receive queues 616, 617 which provide the 
staging of packets into and out of the switch engine. 
InBound and OutBound Port Objects are derived from these Port 
Objects. 
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Switch Engine Object - Provides the data and methods 
for the actual switching machine of the SFPS. This object 
implements a TDM and polling software to service in-bo\ind and 
out-bound ports. The Switch Engine Object is the central 
engine of the SFPS Switch, It provides the context under 
which the switching of packets is performed. 

11.2 SFPS Application Threads 

Several Application Threads exist for SFPS which 
provide fxinctionality required for SFPS which is not in the 
SFPS Switch itself. These mainly deal with the access to 
external servers and control points which exist outside of 
the embedded device. Each of these threads are instantiated 
by the SFPS Application Object. Threads are essentially 
processes or software tasks. Each of the SFPS applications 
are described below. 

SFPS Switch Agent - This thread provides the remote 
management of the SFPS Switch. It implements the managed 
objects which are the objects that provide the SNMP-based 
view of the control and configuration aspects of the switch. 
These managed objects are also used internally to provide 
access from the local console. The actual MIB and its 
managed object definition is set forth in section 11.3. 

SFPS Call Processor - This thread provides the logic 
and interface for translating unknown or broadcast packets 
into third-party call requests. This is a key element of 
providing access through an SFPS Switch, since the Switch 
itself will not provide any switching capability until it is 
"programmed" with connections in the connection table. The 
Call Processor thread processes packets by decoding the 
protocol-specific frames, decoding either MAC addresses or 
network-level addresses inside the network packet to 
determine the end-to-end system path for the connection and 
making API message requests to the SFPS Connection Server. 
The Call Processor specifically translates protocol packets 
into implied connection requests and asks the SFPS connection 



wo 95/20850 



PCTAJS95/01026 



- 66 - 

server to establish a logical path of switched connections 
allowing the source and destination end systems to have a 
uni-directional connection through the SFPS network fabric. 

SFPS Discovery Agent - This thread provides the 
logic and capability to discover adjacent systems attached to 
the SFPS Switch. Specifically, this thread snoops on 
protocol packets and determines if it originated from another 
SFPS Switch (SFPS Adjacency) or from an end system (SFPS 
user). By snooping the packets it decodes and extracts any 
address information inside the packet. In particular, the 
thread extracts the source MAC address and any high-layer 
protocol addresses and, in turn, registers these with an 
external SFPS Directory Server. In addition, it maintains a 
discovery table which shows adjacencies and end systems for 
each inPort and outPort on the switch, 

11,3 MIB and Its Managed Oblect Definition 

CTRON-SFPS-MIR DEFINITIONS : := BEGIN 

sfps-mib.txt 
Revision: 0.0.03 

initial draft 

added outPort in connection table 
added complete enum types for InPort ConfigType 
added a separate outPortTable for 
connect ionTable 

Part Nijmber: 
Date: October 25, 1993 

Cabletron Systems, Inc. 

35 Industrial Way, P.O. Box 5005 Rochester, NH 03867-5005 
(603) 332-9400 
support@ctr on . com 



0.0.01 
0.0.02 
0.0.03 
0.0.04 
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This module provides authoritative definitions for 
Cabletron' s enterprise specific Fast Packet Switching 
MIB . 

This module will be extended, as required. 

Cabletron Systems reserves the right to make changes in 
Specification and other information contained in this 
doc\unent without prior notice. The reader should 
consult Cabletron Systems to determine whether any such 
changes have been made. 

In no event shall Cabletron Systems be liable for any 
incidental, indirect, special, or consequential damages 
whatsoever (including but not limited to lost profits) 
arising but of or related to this document or the 
information contained in it, even if Cabletron Systems 
has been advised of, known, or should have known, the 
possibility of such damages. 

Cabletron grants vendors, end-users, and other 
interested parties a non-exclusive license to use this 
Specification in connection with the management of 
Cabletron products. 

Copyright October 93 Cabletron Systems 

IMPORTS 

OBJECT-TYPE 

FROM RFC-1212 
DisplayString 

FROM RFC1213-MIB 
enterprises, IpAddress, Counter, TimeTicks, Gauge 

FROM RFC1I55-SMI; 
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Cabletron 

OBJECT IDENTIFIER 

mibs 

OBJECT IDENTIFIER 

ctronExp 

OBJECT IDENTIFIER 
ctronSwitch 

OBJECT IDENTIFIER 
switchCommon 

OBJECT IDENTIFIER 
switchSFPS 

OBJECT IDENTIFIER 



= { enterprises 52 } 



{ Cabletron 4 } 



{ mibs 2 } 



= { CtronExp 4 } 



= { CtronSwitch 1 } 



{ CtronSwitch 2 } 



The-SFPS Switch Groups. 



sfpsSwitchEngine 

OBJECT IDENTIFIER 
s f ps S wi t chAgent 

OBJECT IDENTIFIER 



{ switchSFPS 1 } 
{ switchSFPS 2 } 



— The SFPS Switch Engine Groups 



sfpsSwitchSystem 

OBJECT IDENTIFIER 
sfpsSwitchPorts 

OBJECT IDENTIFIER 
sfpsSwitchConnections 

OBJECT IDENTIFIER 



= { SfpsSwitchEngine 1 } 



{ SfpsSwitchEngine 2 } 



= { SfpsSwitchEngine 3 } 



— The SFPS Switch Agent Groups 



s fps Agent SCSDoma in 

OBJECT IDENTIFIER 
s f psAgentTopo 1 ogy 

OBJECT IDENTIFIER 



« { sfpsSwitchAgent 1 } 
= { SfpsSwitchAgent 2 ) 
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sfpsAgentSignalling 

OBJECT IDENTIFIER : = { sf psSwitchAgent 3 } 
stpsAgentDiagnostics 

OBJECT IDENTIFIER : : = { sf psSwitchAgent 4 } 

— The SFPS Switch System Group 

sfpsSystemConf ig 

OBJECT IDENTIFIER : : = { sf psSwitchSystem 1 } 

sfpsSystemStats 

OBJECT IDENTIFIER : : = { sfpsSwitchSystem 2 } 

— The SFPS Switch Ports Group 

sfpsPortConf ig 

OBJECT IDENTIFIER : : = { sfpsSwitchPorts 1 } 

sfpsPortStats 

OBJECT IDENTIFIER : : = { SfpsSwitchPorts 2 } 

— The SFPS Agent SCS Domain Group 

— tbd 

— The SFPS Topology Group 

sf psTopologyUsers 

OBJECT IDENTIFIER : : = { sfps Agent Topology 1 } 
sf psTopologyAd j acencies 

OBJECT IDENTIFIER : : = { sf psAgentTopology 2 } 

— The SFPS Agent Call Processing Group 
~ tbd 

— The SFPS Agent Diagnostics Group 
s f psD i agEventLog 

OBJECT IDENTIFIER : : = { sf psAgentDiagnostics 1 } 

sfpsDiagTesting 

OBJECT IDENTIFIER : : = { sf psAgentDiagnostics 2 } 
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— Textual Conventions 
sfpsSwitchlnstance : := INTEGER 

— this will map to chassis .module index value 
sfpsSwitchPort : := INTEGER 

— this will map to chassis .module. portgroup. 
portsubgroup.port index value 

sfpsAddress ::= OCTET STRING (SIZE (6)) 

— this will map to a MAC address 

— SFPS Switch Engine System Group 

— This group contains the objects that pertain to SFPS 
switching engines at a SFPS switch module single-instance 
level. This group contains two sub-groups: configuration 
and statistics. 

— SFPS Switch Configuration Group 

— This group contains the objects that pertain to the setup 
and configuration of a single instance of an SFPS. 

sfpsSysConf igTable OBJECT-TYPE 

SYNTAX SEQUENCE OF sfpsSysConf iqEntry 

ACCESS not-accessible 
STATUS mandatory 

DESCRIPTION "This table contains the configuration and 
administrative information of each SFPS 
instance. Essentially, a separate SFPS 
instance exists for each switch module. If 
SFPS is not configured on a module, then an 
entry will not exist." 

: : = { sfpsSystemConf ig 1 } 
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s f ps Sy sConf i gEnt r y 
SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



OBJECT-TYPE 



INDEX 



SfpsSysConfigEntry 
not-accessible 
•mandatory 

"Each entry specifies the SFPS 
configuration for the SFPS instance." 
{ sfpsSysConf igSwitchlnstance } 
{ sfpsSysConf igTable 1 } 



SfpsSysConfigEntry : : = 
SEQUENCE { 

SfpsSysConf igSwitchlnstance 
SfpsSysConf igAdminStatus 
SfpsSysConf igAdminReset 
SfpsSysConf igOper Status 
sfpsSysConf igOperTime 
SfpsSysConf igLastChange 
SfpsSysConf igVersion 
SfpsSysConf igMibRev 
SfpsSysConf igHostMgmtPort 
SfpsSysConf igHostCtlPort 
SfpsSysConf igBcastPort 
SfpsSysConf igEr rorPort 
SfpsSysConf igSwitchCapacity 
stpsSysConf igSwitchBW 
SfpsSysConf igHostBW 
SfpsSysConf igFreeBufQSize 
SfpsSysConf igFreeBuf QLen 

} 

SfpsSysConf igSwitchlnstance OBJECT-TYPE 
SYNTAX SfpsSwitchlnstance 
read-only 
mandatory 

"The primary index to the SFPS switch 
table. This identifies the SFPS switch for 
which the entry exists." 



SfpsSwitchlnstance , 

INTEGER, 

INTEGER, 

INTEGER, 

TimeTicks, 

TimeTicks, 

DisplayString, 

DisplayString, 

Sf psSwitchPort , 

Sf psSwitchPort , 

Sf psSwitchPort , 

Sf psSwitchPort , 

INTEGER, 

INTEGER, 

INTEGER, 

Gauge, 

INTEGER 



ACCESS 
STATUS 
DESCRIPTION 
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= { sfpsSysConf igEntry 1 } 



sfpsSysConf igAdminStatus 
SYNTAX INTEGER { 
Other (1) , 
disabled(2) , 
enabledO) 
} 

ACCESS 
STATUS 
DESCRIPTION 



OBJECT-TYPE 

— none of the following 

— shutdown the SFPS 

— startup the SFPS 



read-write 
mandatory 

"Sets the administrative state of the SFPS 
switching services for this SFPS instance. 
This controls the SFPS state at a module 
level. Regardless of the per-port state of 
each SFPS switching port and the state of 
active connections, writing the value 
disabled(2) will cause the SFPS to 
immediately shutdown. A gracefull shutdown 
will be attempted." 
= { SfpsSysConf igEntry 2 } 



s f ps Sy s Conf i g Adm inRe set 

SYNTAX INTEGER { 
other (1), 
reset (2) 
} 

ACCESS 
STATUS 
DESCRIPTION 



OBJECT-TYPE 

— none of the following 
-- force a reset 



read-write 
mandatory 

"Resets this SFPS switch instance. Writing 
a value of reset (2) will force a soft 
restart of the SFPS without any graceful 
shutdown. Any active connections or 
services will be interrupted." 
= { SfpsSysConf igEntry 3 } 
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s f ps SysConf i gOper St at us 
SYNTAX INTEGER { 
Other (1) , 
disabled(2) , 
enabledO) , 



OBJECT-TYPE 



— none of the following 

— not riinning 

— running 

pending-disable(4) , — shut-down in progress 
pending-enable(5) , — start-up in progress 
invalid-conf ig(6) ~ not r\inning, invalid config 

} 

ACCESS read-only 
STATUS mandatory 

DESCRIPTION "Indicates the current operating condition 

of the SFPS instance." 
: : = { sfpsSysConf igEntry 4 } 



sfpsSysConf igOperTime 



OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



TimeTicks 
read-only 
mandatory 

"Indicates the amount of time (« of time 
ticks) that this SFPS switch instance has 
been in its current operational state." 



: : = { SfpsSysConf igEntry 5 } 



SfpsSysConf igLast Change 



OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



TimeTicks 
read-only 
mandatory 

"Indicates the last time a change was made 
to the configuration entry for this SFPS 
switch instance." 
= { SfpsSysConf igEntry 6 } 
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sfpsSysConf igVersion 



OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



DisplayString 
read-only 
mandatory 

"Indicates the current revision level of 
the SFPS MIB for this SFPS switch instance. 
= { SfpsSysConf igEntry 7 } 



sfpsSysConf igMibRev 



OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



DisplayString 
read-only 
mandatory 

"Indicates in textual format the current 
revision level of the Cabletron SFPS MIB 
implemented by the agent for this SFPS 
switch instance." 
= { SfpsSysConf igEntry 8 } 



SfpsSysConf igHostMgmtPort OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



SfpsSwitchPort 
read-only 
mandatory 

"Indicates the SFPS switch port that is 
attached to the Host Management Agent. All 
valid management requests are forwarded to 
this port by default. This is done by 
providing a default entry in the SFPS 
connection table that allows DA-only 
switching to the host port. Specific 
programming of the SFPS connection table 
can override this default." 
{ SfpsSysConf igEntry 9 } 



SfpsSysConf igHostCtlPort OBJECT-TYPE 
SYNTAX SfpsSwitchPort 
ACCESS read-only 
STATUS mandatory 
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DESCRIPTION "Indicates the SFPS switch port that is 
attached to the host for non-management 
packets. This port is knovm as the host 
.control channel." 

: : = { sfpsSysConf igEntry 10 } 



ACCESS 
STATUS 
DESCRIPTION 



SfpsSysConf igBcastPor t OBJECT-TYPE 
SYNTAX SfpsSwitchPort 
read-only 
mandatory 

"Indicates the . SFPS switch port that will 
be fowarded all broadcast (non-unicast ) 
frames that are not explicitly part of a 
connection. By default, this is the host 
control port . " 
= { SfpsSysConf igEntry 11 } 



SfpsSysConf igErrorPort 



OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



SfpsSwitchPort 

read-only 

mandatory 

"Indicates the SFPS switch port that will 
be forwarded all non-broadcast frames that 
are not part of a valid connection." 



= { SfpsSysConf igEntry 12 } 



SfpsSysConf igSwitchCapacity 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



OBJECT-TYPE 



INTEGER 

read-only 

mandatory 

"Indicates the theoretical maximum 
bandwidth of the SFPS switch instance for 
which this entry exists." 



= { SfpsSysConf igEntry 13 } 
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sfpsSysConf igSwitchBW OBJECT-TYPE 
SYNTAX INTEGER 
ACCESS read-write 
STATUS mandatory 

DESCRIPTION "Indicates the percentage of the system 

bandwidth to be allocated to the switch." 
: : = { SfpsSysConf igEntry 14 } 

sfpsSysConf igHostBW OBJECT-TYPE 
SYNTAX INTEGER 
ACCESS read-wr ite 

STATUS mandatory 

DESCRIPTION "Indicates the percentage of the system 
bandwidth to be allocated to the host 
management agent of the switch." 

: : = { SfpsSysConf igEntry 15 } 

SfpsSysConf igFreeBufQSize OBJECT-TYPE 
SYNTAX Gauge 
ACCESS read-only 
STATUS mandatory 

DESCRIPTION "Indicates the maximim number of free 

buffers in the SFPS switch." 
: : = { SfpsSysConf igEntry 16 } 

SfpsSysConf igFr eeBuf QLen OBJECT-TYPE 
SYNTAX INTEGER 
ACCESS read-only 
STATUS mandatory 

DESCRIPTION "Indicates the actual number of free 

buffers left in the SFPS switch." 
: ; = { SfpsSysConf igEntry 17 } 
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— SFPS Switch Statistics Group 

— This group containg the objects that pertain to the 
performance monitoring and statistics of a single instance 
of an SFPS switch. 



sfpsSysStatsTable 
SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



OBJECT-TYPE 
SEQUENCE OF Sf psSysStatsEntry 
not-accessible 
mandatory 

"This table contains the statistics 
information for each SFPS switch instance. 
Essentially, a separate SFPS instance 
exists for each switch module. If SFPS is 
not configured on a module, then an entry 
will not exist. " 
{ sfpsSystemStats 1 } 



s f ps Sy s St at sEn t r y 
SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



INDEX 



OBJECT-TYPE 
SfpsSysStat sEnt r y 
not-accessible 
mandatory 

"Each entry contains the SFPS statistics 

for the SFPS instance." 

{ sfpsSysStatsSwitchlnstance } 



= { SfpsSysStatsTable 1 } 



SfpsSysStatsEntry : : = 
SEQUENCE { 

SfpsSysStatsSwitchlnstance 

sfpsSysStatsAdminStatus 

sfpzSysStatsReset 

sfpsSysStatsOperTime 

sfpsSysStatsInPkts 

sfpsSysStatsOutPkts 



Sf psSwitchlnst ance , 

INTEGER, 

INTEGER, 

TimeTicks , 

Counter , 

Counter , 
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sfpsSysStatsDiscardPkts 

sfpsSysStatsFilteredPkts 

sfpsSysStatsInOctets 

sfpsSysStatsOutOctets 

sfpsSysstatsDiscardOctets 

sfpsSysStatsFilteredOctets 



Counter , 
Counter , 
Counter , 
Counter , 
Counter , 
Counter 



— Do we need to count redirect beast and unknown dest 
packets/bytes? 

} 

sfpsSysStatsSwitchlnstance OBJECT-TYPE 
SYNTAX SfpsSwitchlnstance 
read-only 
mandatory 

"The primary index to the SFPS switch 
table. This identifies the SFPS switch for 
which the entry exists." 
= { sfpsSysStatsEntry 1 } 



ACCESS 
STATUS 
DESCRIPTION 



s f ps Sy sS t at s AdminS t atus OBJECT-TYPE 
SYNTAX INTEGER { 

Other (1) 

disabled(2), 

enabled(3) 



} 



ACCESS 
STATUS 
DESCRIPTION 



read-write 
mandatory 

"Sets the administrative state of the SFPS 
switch statistics. Writing a value of 
enabledO) causes these counters to become 
active for this SFPS switch instance. 
Writing a value of disabled(2) causes these 
counters to become inactive for this SFPS 
switch instance." 
= { SfpsSysStatsEntry 2 } 
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sfpsSysStatsReset 
SYNTAX 



OBJECT-TYPE 
INTEGER { 

Other (1) , 
reset (2) 

} 

read-write 
mandatory 

"Resets the SFPS switch counters for this 
SFPS switch instance. Writing a value of 
reset (2) resets the SFPS switch counters to 
0 and causes sfpsSysStatsOperTime to also 
be reset to 0 . " 
= { sfpsSysStatsEntry 3 } 



ACCESS 
STATUS 
DESCRIPTION 



SfpsSysStatsOperTime OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



TimeTicks 
read-only 
mandatory 

"Indicates the amount of time (# of time 
ticks) that the SFPS switch statistics have 
been active for this SFPS switch instance." 
= { SfpsSysStatsEntry 4 } 



sfpsSysStatsInPkts 
SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



OBJECT-TYPE 
Counter 
read-only 
mandatory 

"Indicates the total number of SFPS packets 
that have been received, on this SFPS 
switch instance, during the time of 
SfpsSysStatsOperTime." 
{ SfpsSysStatsEntry 5 } 
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sfpsSysStatsOutPkts OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



Counter 

read-only 

mandatory 

"Indicates the total nxunber of SFPS packets 
that have been switched , on this SFPS 
switch instance, during the time of 
sf psSysStatSOperTime . " 



: : = { sfpsSysStatsEntry 6 } 



sf ps Sy sSt at sD i s c ar dPkt s OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



Counter 

read-only 

mandatory 

"Indicates the total number of SFPS packets 
that have been discarded, on this SFPS 
switch instance, during the time of 
sfpsSysStatsOperTime. " 



= { SfpsSysStatsEntry 7 } 



s f ps Sy s St at s F i 1 1 er edPk t s OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



counter 

read-only 

mandatory 

"Indicates the total number of SFPS packets 
that have been filtered, on this SFPS 
switch instance, during the time of 
sfpsSysStatsOperTime. " 



: : = { SfpsSysStatsEntry 8 } 



sfpsSysStatsInOctets OBJECT-TYPE 
SYNTAX Counter 
ACCESS read-only 
STATUS mandatory 
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DESCRIPTION "Indicates the total number of SFPS octets 
that have been received, on this SFPS 
switch instance, during the time of 
•sfpsSysStatsOperTime. " 

: : = { sfpsSysStatsEntry 9 } 



sfpsSysStatsOutOctets OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



Counter 
read-only 
mandatory 

"Indicates the total number of SFPS octets 
that have been switched, on this SFPS 
switch instance, during the time of 
SfpsSysStatsOperTime. " 
{ SfpsSysStatsEntry 10 } 



s f ps Sy s S t a t sD i s c a r dOc t et s OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



Counter 

read-only 

mandatory 

"Indicates the total number of SFPS octets 
that have been discarded, on this SFPS 
switch instance, during the time of 
SfpsSysStatsOperTime. " 



: = { SfpsSysStatsEntry 11 } 



sfpsSysStatsFilteredOctets OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



Coxinter 
read-only 
mandatory 

"Indicates the total number of SFPS octets 
that have been filtered, on this SFPS 
switch instance, during the time of 
SfpsSysStatsOperTime . " 
{ SfpsSysStatsEntry 12 } 
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— SFPS Switching Port Group 

— This group contains the managed objects used to setup and 
configure the SFPS ports for packet switching and 
statisics monitoring. This group contains two sub-groups: 
configuration and statistics. 

— SFPS Port Configuration Tables 

— This table contains the managed objects used to set-up and 
configure each SFPS switching port. A seperate table 
exists for inbound ports and outbound ports. 

— Inbound ports. 



sfpsInPortConf igTable OBJECT-TYPE 

SYNTAX SEQUENCE OF SfpsInPortConf igEntry 

not-accessible 
mandatory 

"This table contains the configuration 
information of each configured inbound SFPS 
switch port. If SFPS is not configured on 
a port, then an entry will not exist." 
= { sfpsPortConf ig 1 } 



ACCESS 
STATUS 
DESCRIPTION 



sfpsInPortConfi gEnt r y 



OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



INDEX 



SfpsInPortConf igEntry 

not-accessible 

mandatory 

"Each entry specifies the SFPS 
configuration for the SFPS inboxand switch 
port for which the entry exists." 
SfpsInPortConf igPort } 



= { SfpsInPortConf igTable 1 } 



SfpsInPortConf igEntry : : = 
SEQUENCE { 

sf ps InPortConf igPor t 

sf ps inPortConf igAdminSt atus 

SfpsInPortConf igOper Status 



Sf psSwitchPort , 

INTEGER, 

INTEGER, 
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} 



sfpsInPortConf igOperTime 

sfpsInPortconf igType 

s f ps I nPo r t Conf i gRes er vedBW 

sf ps InPor t Conf i gAl locBW 

SfpsInPortConf igQoS 

s f ps InPor t Conf igQS i ze 

SfpsInPortConf igQLen 



ACCESS 
STATUS 
DESCRIPTION 



TimeTicks, 

INTEGER, 

INTEGER, 

INTEGER, 

INTEGER, 

Gauge , 

INTEGER 



SfpsInPortConf igPort OBJECT-TYPE 
SYNTAX SfpsSwitchPort 
read-only 
mandatory 

"The primary index to the SFPS in port 
table. This identifies the inbound SFPS 
switch port for which the entry exists." 
= { SfpsInPortConf igEntry 1 } 



SfpsInPortConf igAdminStatus 



OBJECT-TYPE 



SYNTAX 



ACCESS 
STATUS 
DESCRIPTION 



} 



INTEGER { 

Other (1) 
disabled(2), 
enabledO) , 
loopback(4) 

read-write 
mandatory 

"Sets the administrative state of the SFPS 
inbound switch port for which the entry 
exists." 
{ SfpsInPortConf igEntry 2 } 



SfpsInPortConf igOperStatus 
SYNTAX INTEGER { 

other (1), 
disabled(2), 
enabledO) , 



OBJECT-TYPE 

none of the following 
not rxmning 
running 
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pending-disable(4) , — shut-down in progress 
pending-enable(5) , — start-up in progress . 
invalid-conf ig(6) , — not running, invalid config 
testing(7) — in loopback mode 

} 

read-only 
mandatory 

"Indicates the current operating condition 
of the SFPS on the inbound switch port for 
which this entry exists.** 
= { sfpsInPortConf igEntry 3 } 



ACCESS 
STAIIUS 
DESCRIPTION 



ACCESS 
STATUS 
DESCRIPTION 



sfpsInPortConfigOperTime OBJECT-TYPE 
SYNTAX TimeTicks 
read-only 
mandatory 

"Indicates the elapsed time, in hundredths 
of a second, that sf psInPortOperStatus has 
been in its current operational state on 
the SFPS inbouaid switch port for which this 
entry exists. " 
= { SfpsInPortConf igEntry 4 } 



SfpsInPortConf igType OBJECT-TYPE 
SYNTAX INTEGER { 



ACCESS 
STATUS 



Other (1) , 
access-port (2) , 
network-port (3) , 
host-mgmt-port(4) , 
host-ct 1-port ( 5 ) 



} 

read-write 
mandatory 
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DESCRIPTION "Sets the type of port access attribute for 
the inboiind SFPS port for which the entry 
exists. Access ports allow single user or 
shared access and perform statistics and 
control; network ports are equivalent to 
trunk ports with no access control; host 
management port indicates the (virtual) 
port to which the (internal) management 
agent is attached; host control port 
indicates the port to redirect 
nonmanagement packets." 

: : = { sfpsInPortConf igEntry 5 } 

s f ps I nPor t Conf i gRe ser vedBW OBJECT-TYPE 
SYNTAX INTEGER 
ACCESS read-write 
STATUS manda t o ry 

DESCRIPTION "Sets the amount of Bandwidth that is 
reserved for the inbound SFPS port for 
which this entry exists. This bandwidth is 
set aside for this port and may be given to 
another port if unused." 

— ? should this be in Mbits/sec or as a percentage of total 

b/w. 

— CXirrently defined as percentage of total b/w in switch. 

: : = { SfpsInPortConf igEntry 6 } 

SfpsInPortConf igAllocBW OBJECT-TYPE 
SYNTAX INTEGER 
ACCESS read-only 
STATUS mandatory 
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DESCRIPTION "Sets the amount of Bandwidth that is 

allocated for the inbound SFPS port for 
which this entry exists. This bandwidth 
may be less than the reserved bandwidth." 



— ? should this be in Mbits/sec or as a percentage of total 
b/w. 

— Currently defined as percentage of total b/w in switch. 

: : = { sfpsInportConf igEntry 7 } 

sfpsInPortConfigQoS OBJECT-TYPE 
SYNTAX INTEGER 
ACCESS read-write 
S TATUS mandat o r y 

DESCRIPTION "Sets the desired QoS service class for the 
inbound SFPS port for which this entry 
exists. " 

— ? should this map to the ATM service classes 

: : = { sfpsInPortConf igEntry 8 } 

sfpsInPortConf igQSize OBJECT-TYPE 
SYNTAX Gauge 
ACCESS read-only 
STATUS mandatory 

DESCRIPTION "Indicates the maximum inbound queue size 
for this port. Size is indicated in 
packets (packet descriptors)." 

: : = { SfpsInPortConf igEntry 9 } 

SfpsInPortConf igQLen OBJECT-TYPE 
SYNTAX INTEGER 
ACCESS read-only 
STATUS mandatory 
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DESCRIPTION "Indicates the actual inbound queue size 
for this port. Size is indicated in 
packets (packet descriptors). This is a 
transient value that reflects the current 
depth of queue . " 

: : = { sfpsInportConf igEntry 10 } 

— Outbound Ports 



ACCESS 
STATUS 
DESCRIPTION 



sfpsOutPortConf igTable OBJECT-TYPE 

SYNTAX SEQUENCE OF SfpsOutPortConf igEntry 

not-accessible 
mandatory 

"This table contains the configuration 
information of each configured outbound 
SFPS switch port. If SFPS is not . 
configured on a port, then an entry will 
not exist." 
= { sfpsPortConf ig 2 } 



SfpsOutPortConf igEntry 



OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



INDEX 



S f p s Out Port Conf i gEn t ry 

not-accessible 

mandatory 

"Each entry specifies the SFPS 
configuration for the SFPS outbound switch 
port for which the entry exists." 
{ SfpsOutPortConf igPort } 



= { SfpsOutPortConf igTable 1 } 



SfpsOutPortConf igEntry : : = 
SEQUENCE { 

SfpsOutPortConf igPort 
SfpsOutPortConf igAdminStatus 
SfpsOutPortConf igOper Status 
SfpsOutPortConf igOperTime 



SfpsSwitchPort , 
INTEGER, 
. INTEGER, 
TimeTicks, 
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sfpsOutPortConf igType 
sf psoutPor tConf igReservedBW 
SfpsOutPortConf igAl locBW 
SfpsOutPortConf igQoS 
SfpsOutPortConf igQSize 
SfpsOutPortConf igQLen 



INTEGER, 

INTEGER, 

INTEGER, 

INTEGER, 

Gauge , 

INTEGER 



SfpsOutPortConf igPort 



OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



SfpsSwitchPort 

read-only 

mandatory 

"The primary index to the SFPS in port 
table* This identifies the outbound SFPS 
switch port for which the entry exists," 



: : = { SfpsOutPortConf igEntry 1 } 



SfpsOutPortConf igAdminStatus 



OBJECT-TYPE 



SYNTAX 



ACCESS 
STATUS 
DESCRIPTION 



INTEGER { . 

other(l), 
disabled(2), 
enabledO), 
loopback(4) 

} 

read-write 
mandatory 

"Sets the administrative state of the SFPS 
outbound switch port for which the entry 
exists." 



: : = { SfpsOutPortConf igEntry 2 } 



SfpsOutPortConf igOper Status 
SYNTAX INTEGER { 

other (1), 
disabled{2), 
enabledO), 
pending-disable(4) 



OBJECT-TYPE 

none of the following 
not running 
running 

shut-down in progress 
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pending-enable(5) , ~ start-up in progress 
invaiid-conf ig(6) , — not running, invalid config 
testing{7) — in loopback mode 



} 

ACCESS 
STATUS 
DESCRIPTION 



read-only 
mandatory 

"Indicates the current operating condition 
of the SFPS on the outbound switch port for 
which this entry exists." 
{ sfpsOutPortConf igEntry 3 } 



ACCESS 
STATUS 
DESCRIPTION 



SfpsOutPortConf igOperTime OBJECT-TYPE 
SYNTAX TimeTicks 
read-only 
mandatory 

"Indicates the elapsed time, in hundredths 
of a second, that sfpsOutPortOperStatus has 
been in its current operational state on 
the SFPS outbound switch port for which 
this entry exists." 
: : = { SfpsOutPortConf igEntry 4 } 

SfpsOutPortConf igType OBJECT-TYf E 
SYNTAX INTEGER { 

Other ( 1 ) , 
access-part{2) , 
network-port ( 3 ) , 
host-mgmt-port(4) , 
host-ctl-port(5) 



ACCESS 
STATUS 
DESCRIPTION 



} 

read-write 
mandatory 

"Sets the type of port access attribute for 
the outbound SFPS port for which the entry 
exists. Access ports allow single user or 
shared access and perform statisics and 
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control; network ports are equivalent to 
trunk ports with no access control; host 
management port indicates the (virtual) 
port to which the (internal) management 
agent is attached; host control port 
indicates the port to redirect 
non-management packets . *' 
= { sfpsOutPortConf igEntry 5 } 



sfpsOutPortConf igReservedBW 



OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



INTEGER 

read-write 

mandatory 

"Sets the amount of Bandwidth that is 
reserved for the outboiind SFPS port for 
which this entry exists. This bandwidth is 
set aside for this port and may be given to 
another port if unused." 



— ? should this be in Mbits/sec or as a percentage of total 
b/w. 

— currently defined as percentage of total b/w in switch. 

: : = { SfpsOutPortConf igEntry 6 } 



sf psOutPort Conf igAl locBW OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



INTEGER 

read-only 

mandatory 

"Sets the amount of Bandwidth that is 
allocated for the outbound SFPS port for 
which this entry exists. This bandwidth 
may be less than the reserved bandwidth.' 



— ? should this be in Mbits/sec or as a percentage of total 
b/w. 

— Currently defined as percentage of total b/w in switch. 
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: : = { sfpsOutPortConf igEntry 7 } 



sfpsOutPortConf igQos OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



INTEGER 

read-write 

mandatory 

"Sets the desired QoS service class for the 
outbound SFPS port for which this entry 
exists . " 



— ? should this map to the ATM service classes 
: : = { SfpsOutPortConf igEntry 8 } 

S f psOut Po r t Conf i gQS i z e OBJECT-TYPE 



Gauge 
read-only 
mandatory 

"Indicates the maximum outbound queue size 
for this port. Size is indicated in 
packets {packet descriptors)." 
= { SfpsOutPortConf igEntry 9 } 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



ACCESS 
STATUS 
DESCRIPTION 



SfpsOutPortConf igQLen OBJECT-TYPE 
SYNTAX INTEGER 

read-only 
mandatory 

"Indicates the actual outbound queue size 
for this port. Size is indicated in 
packets (packet descriptors). This is a 
transient value that reflects the current 
depth of queue . " 
=, { SfpsOutPortConf igEntry 10 } 



— SFPS Switching Port Statistics Tables 

~ This table contains the objects that specify the packet 

— and byte counters for each configured SFPS switching port. 
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— A separate table exists for inbound and outbound ports. 

— Inbound ports. 

sfpsInPortStatsTable OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



SEQUENCE OF Sf psInPortStatsEntry 

not-accessible 

mandatory 

"This table contains the packet and byte 
counters for each inbound SFPS switch port . 



{ sfpsPortStats 1 } 



sfpsInPortStatsEntry 



OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



INDEX 



S f ps I nPo r t S t a t sEnt ry 

not-accessible 

mandatory 

"Specifies the SFPS packet and byte 
counters for the inbound SFPS switch port 
for which this entry exists." 
{ sfpsInPortStatsPort } 



= { SfpsInPortStatsTable 1} 



SfpsInPortStatsEntry : : = 
SEQUENCE { 

SfpsInPortStatsPort 

sfpsInPortStatsAdminStatus 

sfpsinPortStatsReset 

stpsfnPortStatsOperTime 

sfpsInPortStatsPkts 

sfpsInPortStatsDiscardPkts 

sfpsInPortStatsBytes 

sfpsInPortStatsDiscardBytes 

sfpsInPortStatsQOverf lows 

} 

SfpsInPortStatsPort OBJECT-TYPE 
SYNTAX SfpsSwitchPort 
ACCESS read-only 



SfpsSwitchPort, 
INTEGER, 
INTEGER, 
TimeTicks, 
Counter, 
Counter , 
Counter , 
Counter , 
Counter 
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mandatory 

"The primary index to the SFPS port table. 
This identifies the SFPS inbound switch 
port for which the entry exists." 



: : = { sfpsInPortStatsEntry 1 } 



sfpsInPortStatsAdminStatus 



OBJECT-TYPE 



SYNTAX INTEGER { 

other(l), 
disabled(2) , 
enabledO) 

} 

read-write 
mandatory 

"Sets the administrative state of the SFPS 
packet and byte counters on the inbound 
SFPS switch port for which this entry 
exists." 
{ SfpsInPortStatsEntry 2 } 



ACCESS 
STATUS 
DESCRIPTION 



sfpsInPortStatsReset OBJECT-TYPE 
SYNTAX INTEGER { 

other (1), 
reset (2) 



ACCESS 
STATUS 
DESCRIPTION 



} 

read-write 
mandatory 

"Resets the SFPS packet and byte counters 
on the inbound SFPS switch port for which 
this entry exists," 
{ SfpsInPortStatsEntry 3 } 



sfpsInPortStatsOperTime OBJECT-TYPE 
SYNTAX TimeTicks 
ACCESS read-only . 

STATUS mandatory 
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DESCRIPTION "Indicates the amount of time (# of time 
ticks) that the port-specific SFPS packet 
and byte counters have been active on the 
inbound SFPS switch port for which this 
entry exists . " 

: : = { sfpsInPortStatsEntry 4 } 



sfpsInPortStatsPkts OBJECT-TYPE 
SYNTAX Counter 



ACCESS 
STATUS 
DESCRIPTION 



read-only 
mandatory 

"Indicates the total number of SFPS packets 
that have been received, during . 
sfpsInPortStatsOpertime, on the inbound 
SFPS switch port for which this entry 
exists." 
{ SfpsInPortStatsEntry 5 } 



sfpsInPortStatsDiscardPkts 



OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DEiSCRIPTION 



Counter 
read-only 
mandatory 

"Indicates, the total number of SFPS packets 
that have been discarded (dropped), during 
sfpsInPortStatsOpertime, on the inbound 
SFPS switch port for which this entry 
exists." 
= { SfpsInPortStatsEntry 6 } 



sfpsInPortStatsBytes OBJECT-TYPE 
SYNTAX Counter 
ACCESS read-only 
STATUS mandatory 
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DESCRIPTION "Indicates the total nxjmber of SFPS bytes 
that have been received, during 
sf psInPortStatsOperTime, on the inbound 
SFPS switch port for which the entry 
exists.'* 

: : = { sfpsInPortStatsEntry 7 } 



sfpsInPortStatsDiscardBytes OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



Counter 
read-only 
mandatory 

"Indicates the total number of bytes in the 
SFPS packets that have been discarded 
(dropped), during sfpsInPortStatsOperTime, 
on the inbound SFPS switch port for which 
the entry exists. " 
= { SfpsInPortStatsEntry 8 } 



s f ps I nPo r t S t a t sQOver f 1 o ws OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



Counter 
read-only 
mandatory 

"Indicates the total number of queue 
overflow conditions have been experienced 
for the inbound SFPS switch port for which 
the entry exists." 
= { SfpsInPortStatsEntry 9 } 



— Outbound ports. 

sfpsOutPortStatsTable OBJECT-TYPE 

SYNTAX SEQUENCE OF Sf psOutPortStatsEntry 

ACCESS not-accessible 
STATUS mandatory 
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DESCRIPTION "This table contains the packet and byte 
counters for each outbound SFPS switch 
port . " 

: : = { sfpsPbrtStats 2 } 



s f ps OutP or t St at sEnt r y OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



INDEX 



SfpsOutPortStatsEntry 

not-accessible 

mandatory 

"Specifies the SFPS packet and byte 
counters for the outbound SFPS switch port 
for which this entry exists." 
{ sfpsOutPortStatsPort } 



: : = { sfpsOutPortStatsTable 1 } 

SfpsOutPortStatsEntry : : = 
SEQUENCE { 

SfpsOutPortStatsPort 

sfpsOutPortStatsAdminStatus 

sfpsOutPortStatsReset 

sfpsOutPortStatsOperTime 

sfpsOutPortStatsPkts 

sfpsoutPortStatsDiscardPkts 

sfpsOutPortStatsBytes 

sfpaOutPortStatsDiscardBytes 

sfpsoutPortStatsQOverf lows 

} 



sf psSwitchPort , 
INTEGER, 
INTEGER, 
TimeTicks, 
Counter , 
Counter , 
Counter , 
Counter , 
Co\inter 



SfpsOutPortStatsPort OBJECT-TYPE 
SYNTAX SfpsSwitchPort 
ACCESS read-only 
STATUS mandatory 

DESCRIPTION "The primary index to the SFPS port table. 

This identifies the SFPS outbound switch 
port for which the entry exists." 

: : = { SfpsOutPortStatsEntry 1 } 
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sfpsOutPortStatsAdminStatus OBJECT-TYPE 
SYNTAX INTEGER { 

other(l), 
disabled (2) , 
enabledO) 



ACCESS 
STATUS 
DESCRIPTION 



} 

read-write 
mandatory 

"Sets the administrative state of the SFPS 
packet and byte coxinters on the outbound 
SFPS switch port for which this entry 
exists." 
= { sfpsOutPortStatsEntry 2 } 



sfpsOutPortStatsReset OBJECT TYPE 



SYNTAX 



ACCESS 
STATUS 
DESCRIPTION 



INTEGER { 

other (1) , 
reset (2) 

} 

read-write 
mandatory 

"Resets the SFPS packet and byte counters 
on the outbound SFPS switch port for which 
this entry exists." 



= { SfpsOutPortStatsEntry 3 } 



ACCESS 
STATUS 
DESCRIPTION 



sfpsOutPortStatsOperTime OBJECT-TYPE 
SYNTAX TimeTicks 
read-only 
mandatory 

"Indicates the amount of time (# of time 
ticks) that the port-specific SFPS packet 
and byte counters have been active on the 
outbound SFPS switch port for which this 
entry exists. " 
= { SfpsOutPortStatsEntry 4 } 
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sfpsOutPortStatsPkts OBJECT-TYPE 
SYNTAX Counter 



ACCESS 
STATUS 
DESCRIPTION 



read-only 
mandatory 

"Indicates the total number of SFPS packets 
that have been received, during 
sfpsOutPortStatsOpertime, on the outbound 
SFPS switch port for which this entry 
exists. " 
= { sfpsOutPortStatsEntry 5 } 



sfpsOutPortStatsDiscardPkts 



OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



Counter 
read-only 
mandatory 

"Indicates the total number of SFPS packets 
that have been discarded (dropped), during 
sfpsOutPortStatsOpertime, on the outbound 
SFPS switch port for which this entry 
exists . " 
= { SfpsOutPortStatsEntry 6 } 



ACCESS 
STATUS 
DESCRIPTION 



sfpsOutPortStatsBytes OBJECT-TYPE 
SYNTAX Counter 

read-only 
mandatory 

"Indicates the total number of SFPS bytes 
that have been received, during 
sfpsOutPortStatsOperTime, on the outbound 
SFPS switch port for which the entry 
exists . " 
{ SfpsOutPortStatsEntry 7 } 



sfpsOutPortStatsDiscardBytes 
SYNTAX Counter 
ACCESS read-oiily 



OBJECT-TYPE 
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STATUS mandatory 

DESCRIPTION "Indicates the total number of bytes in the 
SFPS packets that have been discarded 
(dropped), during sfpsOutPortStatsOperTime, 
on the outbound SFPS switch port for which 
the entry exists." 

: : = { sfpsOutPortStatsEntry 8 } 

sfpsOutPortStatsQOverf lows OBJECT-TYPE 
SYNTAX Counter 
ACCESS read-only 
STATUS mandatory 

DESCRIPTION "Indicates the total number of queue 

overflow conditions have been experienced 
for the outboxind SFPS switch port for which 
the entry exists . " 

: : = { SfpsOutPortStatsEntry 9 } 

— SFPS Switching Connection Group 

— This group contains the managed objects for maintaining 

— SFPS connections. 

— SFPS connection Table 

— This table contains the SFPS-specif ic connection table 

— managed objects. Note that because this table is indexed 

— by the SfpsSwitchPort index which will map to a 

— chassis. module. portsubgroup.portgroup. port location, this 
. — table will show connections at the chassis', module, 

— portgoups, and port levels. 

sfpsConnectionTable OBJECT-TYPE 

SYNTAX SEQUENCE OF Sf psConnectionEntry 

ACCESS not-accessible 
STATUS mandatory 
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DESCRIPTION "This table contains the connection 

information for all active connections on 
the SFPS access ports." 

: : = { sfpsSwitchConnections 1 } 



s f psConnec t i onEnt ry 



OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



INDEX 



Sf psConnect ionEnt ry 

not-accessible 

mandatory 

"Each entry specifies the connection 
information for the SFPS switch access port 
for which the entry exists." 
{ sfpsCnxInPortr sfpsCnxSource, 
sfpsCnxDestination } 



= { sf psConnect ionTable 1 } 



Sf psConnect ionEnt ry 
SEQUENCE { 



sfpsCnxInPort 


Sf psSwitchPort , 


SfpsCnxSource 


SfpsAddress, 


SfpsCnxDestination 


SfpsAddresS/ 


sfpsCnxRowStatus 


INTEGER, 


s f psCnxA drains t atus 


INTEGER, 


sfpsCnxOutPort 


Sf psSwitchPort , 


sfpscnxAge 


TimeTicks, 


sfpsCnxType 


INTEGER, 


sfpsCnxReservedBW 


INTEGER, 


sfpsCnxAllocBW 


INTEGER, 


sfpsCnxCurrentBW 


INTEGER, , 


sfpsCnxQoS 


INTEGER, 


sfpeCnxPkts 


Counter , 


sfpsCnxBytes 


Counter 
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OBJECT-TYPE 
SfpsSwitchPort 
read-write 
mandatory 

"The primary index to the SFPS in port 
table. This identifies the inbound SFPS 
switch port for which the entry exists." 



= { sfpsConnectionEntry 1 } 



sfpsCnxSource 
SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



OBJECT-TYPE 
SfpsAddress 
read-write 
mandatory 

"The source SFPS address for this 
source/destination connection 



= { SfpsConnectionEntry 2 } 



sf psCnxDest inat i on OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



SfpsAddress 

read-write 

mandatory 

"The destination SFPS address for this 
source/destination connection." 



{ SfpsConnectionEntry 3 } 



sfpsCnxRowStatus OBJECT-TYPE 



SYNTAX 



} 

ACCESS 
STATUS 
DESCRIPTION 



INTEGER { 

other(l) , 
activate(2) , 
deleteO) , 
under-creation( 4 ) 

read-write 
mandatory 

"Controls the creation, modification, and 
deletion of connection entries." 
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= { sfpsConnectionEntry 4 } 



sfpsCnxAcJminStatus 
SYNTAX 



ACCESS 
STATUS 
DESCRIPTION 



OBJECT-TYPE 
INTEGER { 

other(l), 
disabled(2) , 
enabledO) 

} 



read-write 
mandatory 

"Sets the administrative state of the SFPS 
connection.'* 
= { SfpsConnectionEntry 5 } 



sfpsCnxOutPort 
SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



OBJECT-TYPE 
SfpsSwitchPort 
read-write 
mandatory 

"The primary index to the SFPS out port 
table. This identifies the outboxind SFPS 
switch port for which the entry exists. 
All switched traffic for this connection 
will be transmitted on this outbound port." 



= { SfpsConnectionEntry 6 } 



sfpsCnxAge 
SYNTAX 
ACCESS 
STATUS 



OBJECT-TYPE 
TimeTicks 
read-only 
mandatory 



DESCRIPTION "Indicates the age of the connection, 
: : = { SfpsConnectionEntry 7 } 
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OBJECT-TYPE 
INTEGER { 

other ( 1) , 
provisioned(2) , 
switchedO) 

} 

read-write 
mandatory 

"Sets the type of connection. Provisioned 
connections are set up by the external 
agent; switched connections are set up 
dynamically." 
= { sfps Connect ionEntry 8 } 



ACCESS 
STATUS 
DESCRIPTION 



sfps CnxRe s e r vedBW 
SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



OBJECT-TYPE 
INTEGER 
read-write 
mandatory 

"Sets the amount of Bandwidth that is 
reserved for this connection." 



— ? Should this be in Mbits/sec or as a percentage of total 
b/w. 

— Currently defined as percentage of total b/w in switch. 

: : = { sfpsConnect ionEntry 9 } 



sf psCnxAl locBW 
SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



OBJECT-TYPE 
INTEGER 
read-write 
mandatory 

"Sets the amount of Bandwidth that is 
allocated for this connection." 



? should this be in Mbits/sec or as a percentage of total 
b/w. 



wo 95/20850 



PCTAJS95/01026 



- 104 - 

— Currently defined as percentage of total b/w in switch, 

: : = { sfps Connect ionEntry 10 } 

sfpsCnxCurrentBW OBJECT-TYPE 
SYNTAX INTEGER 
ACCESS read-write 
STATUS mandatory 

DESCRIPTION "Indicates the amount of Bandwidth that is 
currently being used for this connection." 

— ? should this be in mbits/sec or as a percentage of total 
b/w. 

— Currently defined as percentage of total b/w in switch. 

: ; = { sfps Connect ionEntry 11 } 

SfpsCnxQoS OBJECT-TYPE 
SYNTAX INTEGER 
ACCESS read-write 
STATUS mandatory 

DESCRIPTION "Sets the desired QoS service class for 
this connection." 

— Should this map to the ATM service classes 

: : = { sfpsConnectionEntry 12 } 

sfpsCnxPkts OBJECT-TYPE 
SYNTAX Counter 
ACCESS read-only 
STATUS mandatory 

DESCRIPTION "Indicates the total number of packets sent 

on this connection." 
: : = { sfpsConnectionEntry 13 } • 

sfpsCnxBytes OBJECT-TYPE 

SYNTAX Counter 

ACCESS read-only 

STATUS mandatory 
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DESCRIPTION "Indicates the total nixmber of bytes sent 

on this connection." 
: : = { sfpsConnectionEntry 14 } 

SFPS Connection Out Port Table 

This table contains the list of outbound ports for a 
connection entry. Note that a uni traffic flow can go out 
multiple outbound ports, which may be useful for virtual 
LANs or multicast groups. 



sfpsConnectionOutPortTable 



OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



SEQUENCE OF Sf psConnectionOutPortEntry 
not-accessible 
mandatory 

"This table contains the control of the 
outbound port for the active connection for 
which this entry exists." 
: : = { sfpsSwitchConnections 2 } 

sf psConnect i onOutPortEnt ry OBJECT-TYPE 

SYNTAX Sf psConnectionOutPortEntry 

not-accessible 
mandatory 

"Each entry specifies the use of the port 
specified by the instance of this entry." 
sf psCnxOutPortlnPort , sf psCnxOutPortSource , 
sfpsCnxOutPortDestination, sfpsCnxOutPortID 
} 



ACCESS 
STATUS 
DESCRIPTION 



INDEX 



{ 



= { SfpsConnectionOutPortTable 1 } 



sfpsConnectionOutPortEntry : : = 
SEQUENCE { 

sfpsCnxOutPortlnPort 
sfpsCnxOutPort Source 
SfpsCnxOutPortDestination 
SfpsCnxOutPortID 



Sf psSwitchPort , 
SfpsAddress, 
SfpsAddress , 
Sf psSwitchPort , 
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sfpsCiixOutPortRowStatus 
sfpsCnxOutPortAdminStatus 



INTEGER, 
INTEGER 



sfpaCnxOutPbrtlnPort OBJECT-TYPE 



SfpsSwitchPort 
read-write 
mandatory 

"The primary index to the SFPS in port 
table. This identifies the inbound SFPS 
switch port for which the entry exists." 
: = { sfpsConnectionOutPortEntry 1 } 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



sfpsCnxOutPortSource OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



SfpsAddress 

read-write 

mandatory 

"The source SFPS address for this 
source/destination connection." 



= { SfpsConnectionOutPortEntry 2 } 



sf psCnxOutPor tDest inat i on OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



SfpsAddress 

read-write 

mandatory 

"The destination SFPS address for this 
source/destination connection." 



= { SfpsConnectionOutPortEntry 3 } 



sfpsCnxOutPortID OBJECT-TYPE 



SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



SfpsSwitchPort 

read-write 

mandatory 

"The primary index to the SFPS in port 
table. This identifies the outbound SFPS 
switch port for which the entry exists." 
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{ sfpsConnectionOutPortEntry 4 } 



sfpsCnxOutPortRowStatus 



OBJECT-TYPE 



SYNTAX 



ACCESS 
STATUS 
DESCRIPTION 



INTEGER { ■ 
other (1) , 
activate(2), 
deleteO), 
under-creat:ion(4 ) 

} 

read-write 
mandatory 

"Controls the creation, modification, and 
deletion of connection entries." 



= { SfpsConnectionOutPortEntry 5 } 



sfpsCnxOutPortAdminStatus OBJECT-TYPE 
SYNTAX INTEGER {. 

other(l), 

disabled(2), 

enabledO) 

} 

read-write 
mandatory 

"Sets the administrative state of the 
outbound port. This allows the outbound 
port to be logically enabled and disabled 
without table addition/deletion." 
= { SfpsConnectionOutPortEntry 6 } 



ACCESS 
STATUS 
DESCRIPTION 



sfpsSCSAddress 
SYNTAX 
ACCESS 
STATUS 
DESCRIPTION 



OBJECT-TYPE 
IpAddress 
read-write 
mandatory 

"Defines the IP Address of the controlling 
SCS Server which controls this SFPS agent." 



: : = { sfpsConfig 1 } 
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sfpsSCSDomain OBJECT-TYPE 
SYNTAX IpAddress 
ACCESS read-write 
STATUS ■ mandatory 

DESCRIPTION "Defines the IP Address of the controlling 
SCS Server which controls this SFPS agent." 
: ; = { sfpsConfig 1 } 

12. Related Applications 

The subject matter of the present application may be 
advantageously combined with the subject matters of the 
following copending and commonly owned applications filed on 
the same date^ and which are hereby incorporated by reference 
in their entirety: 

U.S. Serial No. 08/187,856 entitled Distributed 

Chassis Agent For Network Management, filed January 

28, 1994 by Brendan fee et al.; 

• U.S. Serial No. 08/188,033 entitled Fault Tolerant 
System Management Bus Architecture", filed January 
28, 1994 by Brendan Fee et al. 

While there have been shown and described several 
embodiments of the present invention, it will be obvious to 
those skilled in the art that various changes and 
modifications may be made therein without departing from the 
scope of the invention as defined by the appending claims. 



wo 95/20850 



PCT/US95/01026 



- 109 - 
CLAIMS 

1. A method of controlling switches and transmitting 
data packets in a packet switched data communications 
network, the network including a plurality of end systems and 
switches connected by links, the switches having access ports 
connected to end systems and network ports connected to other 
switches, and each end system having a unique physical layer 
address, the method comprising the steps of: 

prior to transmission of a data packet comprising a 
connectionless datagram from a first end system to a 
second end system, determining a path from the first end 
system to the second end system through a plurality of 
switches and based on the physical layer addresses of the 
first and second end systems, and configuring the 
plurality of switches on the path to enable transmission 
of the data packet, wherein the data packet remains as a 
connectionless datagram. 

2. The method of claim 1, wherein the configuring step 
comprises providing each switch in the path with a connection 
identifier for the data packet, the connection identifier 
including an input port of the respective switch, a physical 
source address of the first end system, and a physical 
destination address of the second end system, and mapping the 
connection identifier to an output port of the respective 
switch. 

3. The method of claim 2, wherein each switch has a 
connection table and the programming step includes entering 
the connection identifier in the connection table at each 
respective switch on the path. 

4. The method of claim 3, further including the step of 
deleting the connection identifier from the connection table 
after a predetermined time. 
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5. The method of claim 3, wherein multiple data packets 
having the same connection identifier are transmitted through 
the network by accessing the connection tables in the 
switches on the path, without redetermining the path. 

6. The method of claim 1, wherein the determining step 
includes determining multiple paths for transmission of a 
data packet from a first end system to a plurality of second 
end systems, and configuring each of the switches on the 
multiple paths. 

7. The method of claim 1, wherein the determining step 
includes address learning by pairing a source address within 
an incoming data packet with the port on which the packet 
arrives at the respective switch, and registering the pairs 
in a central directory which maintains such pairs for all of 
the switches in the network. 

8. The method of claim 1, wherein the determining step 
is initiated when the data packet enters a first switch 
adjacent to the first end system, and the data packet is 
stored during the determining and configuring steps. 

9. The method of claim 1, wherein the determining step 
includes, when a first switch receives a broadcast data 
packet, looking inside the broadcast data packet for higher 
layer protocol information to determine the physical layer 
address of the second end system for which the data packet is 
intended . 

10. The method of claim 1, wherein the determining step 
includes, when a first switch receives a data packet having 
an unknown destination address, looking inside the data 
packet for higher layer protocol information to determine the 
second end system for which the data packet is intended. 
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11. The method of claim 10, further including the first 
switch sending a reply back to the first end system with the 
physical address of the second end system. 

12. The method of claim 1, wherein the determining step 
includes sending a connection set-up request to a connection 
service for determining the path and configuring the switches. 

13. The method of claim 1, wherein multiple data packets 
are transmitted from the first end system to the second end 
system on the same path without redetermining the path. 

14. The method of claim 1, wherein the configuring step 
includes configuring the switches for transmission out 
multiple ports simultaneously. 

15. The method of claim 1, wherein the switch transmits 
data packets received from different first end systems but 
intended for one second end system, out different ports. 

16. In a packet switched data communications network, 
the network including a plurality of end systems and switches 
connected by links, the switches having access ports 
connected to end systems and network ports connected to other 
switches, and each end system having a unique physical layer 
address, the switch including a connection database of valid 
connections between different ports on the switch and a 
switching mechanism for establishing temporary connections 
between different ports on the switch, characterized by a 
central connection server coupled to each switch, means for 
registering each switch with the server, and means, prior to 
transmission of a data packet comprising a connectionless 
datagram from a first end system to a second end system, for 
determining a path of valid connections from the first end 
system to the second end system through one or more switches 
and configuring the connection table of each switch on the 
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path with a connection identifier identified by the physical 
layer addresses for the first and second end systems, wherein 
the data packet remains as a connectionless datagram. 

17. The network of claim 16, wherein the connection 
identifier includes an input port of the respective switch, a 
physical source address of the first end system, and a 
physical destination address of the second end system, and 
which connection identifier is mapped to an output port of 
the respective switch. 

18. The network of claim 16, further including means for 
deleting the connection identifier from the connection table 
after a predetermined time. 

19. The network. of claim 16, wherein each switch 
includes means for address learning by pairing a source 
address within an incoming data packet with the port on which 
the packet arrives at the respetive switch, and the means for 
registering includes a central directory which maintains such 
pairs for all of the switches in the network. 

20. The network of claim 16, wherein each switch 
includes means for storing the data packet while the path is 
determined and the switches are configured. 

21. The network of claim 16, wherein the means for 
determining include means for looking inside a data packet 
which does not contain the physical layer address of the 
second end system, for higher layer protocol information to 
determine the second end system for which the data packet is 
intended . 

22. The network of claim 21, further including means for 
sending a reply to the first end system with the physical 
layer address of the second end system. 
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23. The network of claim 16, wherein each switch 
includes means for sending a connection setup request to the 
central connection server . 

24. The network of claim 16, wherein the central 
connection server is external to the switches. 

25. The network of claim 16, wherein the means for 
determining the connection identifier is exclusive to the 
central connection server. 

26. The network of claim 16, wherein the determining 
means includes: 

means for authorizing valid connections between 
first and second end systems. 

27. The network of claim 26, wherein the authorizing 
means includes: 

a directory database of valid connections between 
first and second end systems; 

means for accessing the directory database to 
determine if there is a valid connection. 

28. The network of claim 16, wherein the determining 
means includes; 

means for determining a best path for the valid 
connection through the switches of the network. 

29. The network of claim 28, wherein: 

the means for determining the best path utilizes a 
number of constraints including one or more of: 
bandwidth; 
cost; 
QOS;and 

a maximum number of connections. 



wo 95/20850 



PCrAJS95/01026 



- 114 - 

30. The network of claim 16, wherein the determining 
means includes: 

means for determining a valid connection which 
varies with time or the application of different 
constraints. 

31. The network of claim 16, further including means for 
allocating a specified bandwidth to a connection. 

32. The network of claim 16, including a management 
information base for controlling the switch operation and 
configuration. 

33. The network of claim 16, wherein the determining 
means is part of a network management system which provides 
at least one of the following services: 

a) determination of a best path between first and 
second end systems; 

b) designation of valid connections between first and 
second end systems; 

c) determination of the location of end systems; 

d) accovmting of each end system's usage of the network 
based on the nximber of data packet transmissions or 
bytes ; 

e) designation of a. specified bandwidth for connections 
between designated end systems. 

34. The network of claim 16, wherein the physical layer 
address is a MAC address. 

35. The network of claim 16, wherein the configuring 
means includes: 
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means for setting up the temporary connection; 
means for forwarding the data packet transmission; 

and 

means for terminating the temporary connection. 

36. In a method of breadth-first searching to build a 
spanning tree, wherein a plurality of traversals are made of 
different paths moving outwardly from a starting point in a 
search to find a best path to a destination point based on a 
plurality of metrics, the improvement comprising: 

at the end of each traversal, comparing the values 
of the metrics and eliminating the paths which are not 
best or do not pass a threshold level in at least one 
metric . 

37. The method of claim 36, wherein the comparing step 
comprises eliminating a path which is not better in at least 
one metric. 

38. The method of claim 36, wherein the comparing step 
comprises eliminating a path which is not better or equal in 
at least one metric. 

39. The method of claim 36, wherein the comparing step 
comprises eliminating a path which is not better or equal in 
at least one metric or which does not pass a threshold level. 

40. The method of claim 36, wherein all of the values 
and paths for a given traversal are stored and processed 
together . 

41. In a method for routing data packets through a mesh 
of nodes and arcs, the improvement comprising: 

a) selecting a plurality of (n + 1) metrics and 

designating a plurality of possible values for each 
metric from best to worst; 
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b) selecting a minimum acceptable value for each 
metric; 

c) assxuning an initial set of values for the metrics; 

d) starting at a source node, determining a plurality 
of possible paths by discovering all immediate 
neighboring nodes and determining a traversal* set of 
metric values for each path; 

e) repeating step d) for each discovered node and 
continuing until a destination node is reached; and 

f) eliminating certain traversal sets of values during 
the repeating step e) in accordance with the 
following rules: 

1) if a path discovers a node already within the 
path, terminating the path; 

2) if a path discovers that its traversal value 
vector is not best in any of 

(n + 1) metrics, terminating the path; 

3) if a path has no metric which is better than one 
of the already completed paths, terminating the 
path; 

4) if a path discovers a defective arc or node, 
terminating the path; 

5) if a path has a metric value which does not 
satisfy a threshold level, terminating the path; 
and 

6) if a path discovers an end node which is not the 
destination node, terminating the path. 

42. A method of allocating a bandwidth- limited, shared 
resource among a plurality of competing devices, comprising 
the steps of : 
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dividing an available time of the resource into a 
plurality of time segments; 

allocating one or more of the time segments among 
the competing devices in a predetermined order to provide 
a first level of arbitration; 

providing a list of competing devices; 

allocating a token entitling one of the competing 
devices in the list of competing devices to a time 
segment; 

allocating a time segment to the competing device 
having the token if the time segment is unallocated after 
the first level of arbitration to provide a second level 
of arbitration; and 

allocating the time segment to the device having a 
predetermined rank in the list of competing devices if 
the time segment is unallocated after the second level of 
arbitration to provide a third level of arbitration. 

43. A system for allocating a bandwidth-limited, shared 
resource among a plurality of competing devices, comprising: 

means for dividing an available time of the resource 
into a plurality of time segments; 

means for allocating the time segments among the 
competing devices in a predetermined order to provide a 
first level of arbitration; 

means for providing a list of competing devices; 

means for allocating a token entitling one of the 
competing devices in the list of competing devices to a 
time segment; 

means for allocating a time segment to the competing 
device having the token if the time segment is 
unallocated after the first level of arbitration to 
provide a second level of arbitration; and. 
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means for allocating the time segment to the device 
having a predetermined rank in the list of competing 
devices if the time segment is unallocated after the 
second level of arbitration to provide a third level of 
arbitration. 
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TO THE NEXT COMPETING 
DEVICE IN THE UST OF 
COMPETING DEVICES 



522 



FigBB 
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SEND ENABLE SIGNAL TO 

COMPETING DEVICE 
SELECTED IN STEPS 510 
516 OR 520 



523 




Fig. 19 C 
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12 PORT ETHERNET a BACKPLANE EXAMPLE 



PORTS 1-12==ETHERNET 
PORTO== BACKPLANE 
P0RT13== HOST CPU 

WRAP REGISrER=ADDRESS 24 

RAM TRAVERSED IN 25*400nS 
OR APPX=10 uSEC 

RAM IS TRAVERSED 100K/SEC 

EACH ETHERNETGETS 100K*256 BITS 
OR 25.6 MBITS/SEC 

HOST GETS lOOK* 256 
OR 25 6 MBITS/SEC 

BACKPLANE GETS 100K»^ 256*12 
OR APPX=307 MBrrS/SEC 



NOrE:PORT NUMBERS ARE EXAMPLES 



ADDRESSO P0RT1D1 
ADDRESS 1 PORT ID 0 
ADDRESS 2 PORT ID 2 
ADDRESS 3 PORTIDO 
ADDRESS 4 PORT ID 3 

ADDRESS 5 PORTIDO 
ADDRESS 6 PORT! D 4 
ADDRESS 7 PORTIDO 
ADDRESS8P0RTID5 
ADDRESS 9 PORTIDO 
ADDRESS10P0RTID6 
ADDRESS 11 PORTIDO 
ADDRESS 12 PORT I D13 
ADDRESS 13 PORT ID 7 
ADDRESS 14 PORTIDO 
ADDRESS 15 PORT ID 8 
ADDRESS 16 PORTIDO 

ADDRESS 17 PORT ID 9 
ADDRESS 18 PORT I DO 
ADDRESS 19P0RTID10 
ADDRESS 20P0RT ID 0 
ADDRESS 21 PORT ID11 
ADDRESS 22 PORTIDO 
ADDRESS 23 PORT ID12 
ADDRESS 24P0RTID0 



Fig.20 
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SFPS 
APPLICATION 
OBJECT 





'603 



604 



'605 



'^HOST-LEVEL APPLICATION 
THREADS 60£ 



600 



607' 



IN 
PORTS 





TABLE 606n 



















(^60d 



OUT 
PORTS 



SWrrCH ENGINE 



"^SWrrCH OBJECT 
60I 



^609 



Fig.21 



TX QUEUE 
616 



614- 



FRAMING 
OBJECT 



OBJECfl 



PCS 



MEDIA 
DEVICE DRIVER 



PHYSICAL 
PORT 



RX QUEUE 
617 



.612 
615 



.613 
.611 



SFPS PORT 
OBJECT 610 

Fig.22 
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Method for controlling switches and transmitting data 
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work, comprising path determination based on physical 
layer addresses and configuration of the switches, and 
network using said method. 
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In which values of metrics are compared and paths eliminated. 
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